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1.0  INTRODUCTION 


ADS  is  a  general  purpose  numerical  optimization  program  containing  a  vide 
tv  of  algorithms.  The  problem  solved  is: 


Minimize  F(X) 

Subject  to; 

G.(X)  .LE.  C  j  =1 ,  m 

Hk(X)  .EG.  0  k= 1 , L 

XL.  . LE.  X.  .LE.  XU.  i  =  l,n 

li  l 

The  solution  of  this  general  problem  is  separated  into  three  baric  lev  ■.•Is: 

1.  STRATEGY  -  For  example,  Sequential  Unconstrained  Minimization  or  Sequential 
Linear  Programming.  The  purpose  of  a  strategy  is  to  convert  tne  original 
constrained  problem  into  a  sequence  of  approximate  problems  using  various 
techniques.  A  strategy  is  not  used  for  unconstrained  problems.  In  that 
case,  the  parameter,  ISTRAT,  is  set  to  zero. 


2.  OPTIMIZER  -  For  example,  Variable  Metric  methods  for  unconstrained 
minimization  or  the  Method  of  Feasible  Directions  for  constrained 
minimization.  The  optimizer  performs  the  actual  function  minimization  of 
either  the  original  problem  (if  ISTRAT=0)  or  the  approximate  problem  (if 
ISTRAT  is  greater  than  zero). 

3.  ONE-DIMENSIONAL  SEARCH  -  For  example,  Golden  Section  or  Polynomial 
Interpolation.  The  one-dimensional  search  is  called  by  the  optimizer  and, 
in  some  cases,  the  strategy.  By  choosing  L  Strategy,  Optimizer  and  One- 
Dimensional  Search,  the  user  is  given  considerable  flexibility  in  creating 
an  optimization  program  vhich  works  well  fc  given  class  of  design 
problems . 

Additionally,  we  may  consider  another  component  to  be  problem  formulation. 
It  is  assumed  that  the  engineer  makes  every  effort  to  formulate  the  problem  in  a 
form  amenable  to  efficient  solution  by  numerical  optimization.  This  aspect  is 
perhaps  the  most  important  ingredient  to  the  efficient  use  of  the  ADS  program 
fur  solution  of  problems  of  practical  significance. 

This  manual  describes  the  use  of  the  ADS  program  and  the  available  program 
options.  Section  1.1  describes  the  enhancements  and  modifications  to  the  ADS 
program  subsequent  to  Version  1.00  (ref.  1).  Section  i  identifies  the  available 
optimization  strategies,  optimizers  and  one-dimensional  search  algorithms. 
Section  3  defines  the  program  organization,  and  Section  4  gives  user 
instructions.  Section  "  presents  severs!  s'^ple  examples  to  aid  the  user  in 
becoming  familiar  with  the  ADS  program.  Section  6  gives  a  simple  main  program 
that  is  useful  for  general  design  applications. 


1.1  Enhancements  and  Modifications  Since  Version  1.00 


Since  the  release  of  Version  1.00  in  May  of  198A,  numerous  modifications 
and  enhancements  have  been  made  to  the  program.  Many  of  these  are  minor  and  are 
transparent  to  the  casual  user.  These  include  various  formatting  changes, 
internal  logic  enhancements  to  improve  program  flow,  and  a  few  actual  bugs  in 
the  FORTRAN.  Because  of  the  robustness  of  the  basic  program,  where  bugs  exist, 
their  correction  often  is  detected  only  in  special  test  cases.  Examples  of  this 
are  correction  of  an  error  in  using  the  absolute  convergence  criteria  and 
correction  of  polynomial  one-dimensional  search  when  a  constraint  is  being 
followed.  Other  enhancements  include  checking  to  insure  the  initial  design  does 
not  violate  any  side  constraints,  and  checking  to  be  sure  the  combinations  of 
strategy,  optimizer  and  one-dimensional  search  are  valid. 

Enhancements  to  the  program,  beyond  the  original  capability,  include 
addition  of  equality  constraint  capability  throughout  the  program  and  addition 
of  a  new  strategy. 

Equality  constraints  are  now  available  in  all  options  of  the  program, 
whereas  in  Version  1.00  they  were  only  available  when  using  penalty  function 
strategies.  Specifically,  equality  constraints  have  been  added  to  optimizers  A 
and  5.  Here,  two  approaches  were  investigated.  The  first  was  to  formally  treat 
them  in  a  mathematical  sense.  This  requires  considerable  program  logic  and 
usually  insures  rather  precise  following  of  the  constraints,  but  at  some 
efficiency  cost.  The  second  approach,  and  that  used  here,  was  to  treat  equality 
constraints  via  a  linear  penalty  function  and  an  equivalent  inequality 
constraint.  The  basic  concept  is  to  first  change  the  sign  on  the  constraint,  if 
necessary,  so  that  the  scalar  product  of  the  gradient  of  the  constraint  with  the 
gradient  of  the  objective  function  is  negative.  The  constraint  is  then 
converted  to  a  non-positive  inequality  constraint  and  a  linear  penalty  is  added 
to  the  objective.  The  penalty,  together  with  the  conversion  to  an  inequality 
constraint  have  the  effect  of  driving  the  original  equality  constraint  to  zero 
at  the  optimum,  but  without  demanding  precise  accuracy,  with  its  corresponding 
inefficiency.  This  is  in  keeping  with  the  general  philosophy  of  ADS  of  finding 
a  near  optimum  design  quickly. 

A  new  strategy  (ISTRAT=9),  called  Sequential  Convex  Programming,  developed 
by  Fleury  and  Briabant  (ref.  2),  has  been  added  to  ADS.  The  basic  concept  of 
this  strategy  is  that  a  linear  approximation  to  the  objective  and  constraint 
functions  is  first  created,  just  as  in  sequential  linear  programming.  However, 
during  the  approximate  optimization  sub-problem,  either  direct  or  reciprocal 
variables  are  used,  depending  on  the  sign  of  the  corresponding  components  of  the 
gradients.  This  creates  a  conservative  convex  approximation  to  the  optimization 
problem  in  comparison  to  a  simple  linearization.  In  reference  2,  the  method  was 
applied  to  structural  optimization  problems  in  which  all  design  variables  were 
positive.  It  was  shown  that  move  limits  were  not  required  during  the 
sub-problem  and  that  the  method  converged  quickly  to  the  optimum.  Vhen 
incorporating  the  algorithm  into  ADS,  move  limits  were  included,  but  they  are 
less  stringent  than  for  sequential  linear  programming.  This  is  based  on  the 
experience  that  the  design  space  car.  become  i  1 1  -mndi  t  i  oned  in  general 
applications.  Also,  reciprocal  variables  are  only  used  if  the  design  variable 
is  positive. 
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In  earlier  versions  of  ADS,  when  scaling  was  performed,  the  scaled 
constraints  were  printed.  In  this  version,  the  constraints  are  unsealed  prior 
to  printing.  In  the  one-dimensional  search,  the  variables  and  function  values 
are  nov  unsealed  prior  to  printing.  Also,  in  all  printing,  a  number,  followed 
by  a  decimal  are  now  used  instead  of  the  earlier  E x format,  to  improve 
r  e  a  d  a  b  i  I  i  t  y . 

Perhaps  "he  most  significant  program  modification  is  in  the  scaling 
algorithm  itself.  The  original  scaling  algorithm  appeared  quite  sophisticated 
and,  when  it  worked,  it  seemed  very  good.  However,  in  those  cases  where  it 
produced  poor  scaling,  the  results  were  often  disastrous.  Unfortunately,  it  was 
not  possible  to  predict  when  it  would  or  would  not  work.  A  particularly 
disturbing  feature  was  that,  sometimes  the  scaled  constraints  were  satisfied 
within  a  small  tolerance  during  optimization,  but  at  the  end  when  the  unsealed 
values  were  printed,  they  were  greatly  violated.  This  provided  the  important 
information  that  the  user  had  probably  not  carefully  scaled  the  constraints  to 
begin  with.  However,  this  is  not  obvious  to  most  users  and  so  it  often  led  to 
practical  difficulties  when  using  ADS. 

A  completely  new  scaling  algorithm  has  been  used  in  Version  2.00  which,  is 
in  many  ways  similar  to  the  time  honored  normalization  method  used  in  the  old 
CON’MIN  program.  However,  in  addition  to  normalizing  the  design  variables,  the 
objective  and  constraints  are  also  scaled.  If  the  problem  is  naturally  well 
scaled,  the  scale  factor  will  be  unity,  but  if  the  function  and  gradient 
information  suggests  a  better  scaling,  this  will  he  attempted.  On  test 
problems,  this  has  been  found  to  be  a  significant  improvement  over  the  previous 
seal i ng  rou tine. 


2.0  PROGRAM  OPTIONS 

In  this  section,  the  options  available  in  the  ADS  program  are  identified. 
At  each  of  the  three  solution  levels,  several  options  are  available  to  the  user. 

2.1  Strategy 

Table  1  lists  the  strategies  available.  The  parameter  ISTRAT  will  be  sent 
to  the  ADS  program  to  identify  the  strategy  the  user  wants.  The  ISTRAT=0  option 
would  indicate  that  control  should  transfer  directly  to  the  optimizer.  This 
would  be  the  case,  for  example,  when  using  the  Method  of  Feasible  Directions  tr 
solve  constrained  optimization  problems  because  the  optimizer  works  directl 
with  the  constrained  problem.  On  the  other  hand,  if  the  constraint 
optimization  problem  is  to  be  solved  by  creating  a  sequence  of  unconstrained 
minimizations,  with  penalty  functions  to  deal  with  constraints,  one  of  the 
appropriate  strategies  would  be  used. 
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TABLE  1:  STRATEGY  OPTIONS 


ISTRAT  _  STRATEGY  TO  BE  USED 

0  None.  Go  directly  to  the  optimizer. 

1  Sequential  unconstrained  minimization  using  the  exterior  penalty 
function  method  (refs.  3,  4). 

2  Sequential  unconstrained  minimization  using  the  linear  extended  interior 
penalty  function  method  (refs.  5-7). 

3  Sequential  unconstrained  minimization  using  the  quadratic  extended 
interior  penalty  fumtion  method  (refs.  8,  9). 

4  Sequential  unconstrained  minimization  using  the  cubic  extended  interior 
penalty  function  method  (ref.  10). 

5  Augmented  Lagrange  Multiplier  method  (refs.  11-15). 

6  Sequential  Linear  Programming  (refs.  16,  17). 

7  Method  of  Centers  (method  of  inscribed  hyperspheres),  (ref.  18). 

8  Sequential  Quadratic  Programming  (refs.  13,  19,  20). 

9  Sequential  Convex  Programming  (ref.  2). 


2.2  Optimizer 


Table  2  lists  the  optimizers  available.  I0PT  is  the  parameter  used  to 
indicate  the  optimizer  desired. 

TABLE  2:  OPTIMIZER  OPTIONS 

iopt _ _ _ 

0  None.  Go  directly  to  the  one-dimensional  search.  This  option  should  be 
used  only  for  program  development. 

1  Fletcher-Re^ves  algorithm  for  unconstrained  minimization  (refs.  21). 

2  Davidon-Fle tcher-Povell  (DFP)  variable  metric  method  for  unconstrained 
minimization  (refs.  22,  23). 

3  Broydon-Fletcher-Goldfarb-Shanno  (BFGS)  variable  metric  method  for 
unconstrained  minimization  (refs.  24-27). 

4  Method  of  Feasible  Directions  (MFD)  for  constrained  minimization  (refs. 
28,  29). 

5  Modified  Method  of  Feasible  Directions  for  constrained  minimization 
(ref.  30). 


In  choosing  the  optimizer  (as  veil  as  strategy  and  one-dimensional  search) 
it  is  assumed  that  the  user  is  knowledgeable  enough  to  choose  an  algorithm 
consistent  with  the  problem  at  hand.  For  example,  a  variable  metric  optimizer 
would  not  be  used  to  solve  constrained  problems  unless  a  strategy  is  used  to 
create  the  equivalent  unconstrained  minimization  task  via  some  form  of  penalty 
function . 
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2.3  One-Dimensional  Search 


Table  3  lists  the  one-dimensional  search  options  available  for 
unconstrained  and  constrained  problems.  Here  IONED  identifies  the  algorithm  to 
be  used . 

TABLE  3:  ONE- DIMENSIONAL  SEARCH  OPTIONS 

IONED  __  _  ONE-DIMENSIONAL  SEARCH^ OPTION  (refs.  3,  31,  32) 

1  Find  the  minimum  of  an  unconstrained  function  using  the  Golden  Section 

no  thod . 

2  Find  the  minimum  of  an  unconstrained  function  using  the  Golden  Section 
method  followed  by  polynomial  interpolation. 

3  Find  the  minimum  of  an  unconstrained  function  by  first  finding  bounds 
and  then  using  polynomial  interpolation. 

4  Find  the  minimum  of  an  unconstrained  function  by  polynomial 

i n t er pola t ion/ex t rapola t ion  without  first  finding  bounds  on  the 
s  o  I  u  t  i  o  n  . 

3  Find  the  minimum  of  an  constrained  function  using  the  Golden  Section 

me  thod  . 

6  Find  the  minimum  of  an  constrained  function  using  the  Golden  Section 

method  followed  by  polynomial  interpolation. 

?  Find  the  minimum  of  an  constrained  function  by  first  finding  bounds  and 

then  using  polynomial  interpolation. 

8  Find  the  minimum  of  an  constrained  function  by  polynomial 

interpolation/extrapolation  without  first  finding  bounds  on  the 
s  o  1  u  t  i  o  n  . 


2 . 4  A 1 1 n v a b I o _C o mbinations  of  Algor i thms 

No*  all  combinations  of  strategy,  optimizer  and  one-dimensional  search  are 
meaningful .  For  example,  constrained  one-dimensional  search  is  not  meaningful 
when  minimizing  unconstrained  functions. 

Table  4  identifies  the  combinations  of  algorithms  which  are  available  in 
the  ADS  program.  In  this  table,  an  X  is  used  to  denote  an  acceptable 
combination  of  strategy,  optimizer  and  one-dimensional  search.  An  example  is 
shown  by  the  heavy  line  on  the  table  which  indicates  that  constrained 
optimization  is  to  be  performed  by  the  Augmented  Lagrange  Multiplier  Method 
(ISTRAT--5),  using  the  BFGS  optimizer  (I0PT=3)  and  polynomial  interpolation  with 
bounds  for  the  one-dimensional  search  (I0NED=3).  From  the  table,  it  is  clear 
that  a  large  number  of  possible  combinations  of  algorithms  are  available. 
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TABLE  4:  COMBINATIONS  OF  ALGORITHMS  ALLOWED 


OPTIMIZER 


STRATEGY 

1 

2 

3 

4 

5 

0 

X 

X 

X 

X 

X 

1 

X 

X 

X 

0 

0 

2 

X 

X 

X 

0 

c 

3 

X 

X 

X 

0 

0 

4 

X 

X 

X 

0 

0 

a - 

-  X  — 

—  x  — *GD 

0 

0 

6 

0 

0 

0 

X 

X 

7 

0 

0 

0 

X 

X 

8 

0 

0 

0 

X 

X 

9 

0 

0 

0 

X 

X 

ONE-D  SEARCH 

1 

X 

X 

X 

0 

0 

2 

X 

X  \ 

'X 

0 

0 

3 

X 

X 

E 

0 

0 

4 

X 

X 

X 

0 

0 

5 

0 

0 

0 

X 

X 

6 

0 

0 

0 

X 

X 

7 

0 

0 

0 

X 

X 

8 

0 

0 

0 

X 

X 

Appendix  A  contains  an  annotated  version  of  Table  4  for  convenient 
reference  once  the  user  is  familiar  with  ADS. 

To  conserve  computer  storage,  it  may  be  desirable  to  use  only  those 
subroutines  in  the  ADS  system  needed  for  a  given  combination  of  ISTRAT,  IOPT  and 
IONED .  Appendix  C  provides  the  information  necessary  for  this.  Appendix  D 
lists  the  ADS  subroutines  with  a  very  brief  description  of  each. 

In  writing  a  program  to  call  ADS,  the  user  should  be  aware  that  subroutine 
names  should  not  be  duplicated.  This  is  seldom  a  problem  with  ADS  because  each 
routine  begins  with  the  letters  A-D-S,  followed  by  a  three  digit  number  (except 
the  ADS  routine  itself,  which  has  no  trailing  numbers.  Thus,  the  user  need  only 
be  sure  not  to  use  subroutines  with  this  numbering  sequence. 

3.0  PROGRAM  FLOW  LOGIC 

ADS  is  called  by  a  user-supplied  calling  program.  ADS  does  not  call  any 
user-supplied  subroutines.  Instead,  ADS  returns  control  to  the  calling  program 
when  function  or  gradient  information  is  needed.  The  required  information  is 
evaluated  and  ADS  is  called  again.  This  provides  considerable  flexibility  n 
program  organization  and  restart  capabilities. 

The  algorithms  in  ADS  are  called  gradient  based  methods.  That  is  they 
require  the  calculation  of  the  gradients  of  the  objective  and  constraint 
functions.  In  most  applications,  the  user  does  not  choose  to  calculate  gradient 
information  (often  it  is  not  possible  because  of  the  implicit  nature  of  the 
problem).  Therefore,  the  default  case  is  that  ADS  will  calculate  al1  needed 
gradient  information  using  a  first  forward  finite  difference  scheme.  The 
exception  to  this  is  that,  if  a  variable  is  at  its  upper  bound,  a  first 


6 


a  rds  finite  difference  step  is  taken.  This  is  because  *he  bounds  on  the 
n  variables  are  considered  to  be  absolute  and  ADS  will  not  consider  a 
n  outside  the  specified  bounds,  even  during  gradient  computations.  The 
lion  to  •’his  is  that,  if  the  bounds  are  nearly  equal,  the  insulting 
ails  finite  difference  step  may  violate  the  lower  bound. 

A  ho,  ADS  has  numerous  internal  parameters  that  control  the  optimisation 
s.  .  These  all  have  default  values  that  are  used  unless  t  ho  user 
ft  sally  cnanges  them. 


loco,  ADS  can  be  used  in  four  principal  modes: 

Default  Control  parameters  and  finite  difference  gradients. 

-ride  default  parameters,  use  finite  difference  gradients. 

-  :  au  i  t  control  parameters  and  user -supplied  gradients. 

've:  :  id  a  default  parameters  and  it  tier -supp  lied  gradient. 

!":-.e  fits:  mode  is  the  simplest  "black  box"  approach.  In  the  second  mode, 

. .  •  • :  over  rides  the  default  parameters  to  "fine  tune"  the  program  for 

v .  In  modes  1  and  4,  the  user  supplies  all  needed  gradient  information 

o  1  is  the  p-ogram  flow  diagram  for  the  simplest  use  of  ADS.  The  user 
•y  ••!  c;  f  i .  ing  the  basic  control  parameters  and  arrays  (to  be  described  in 
•*  !  .  Ihe  gradient  computation  parameter,  IGRAD,  is  se  .  to  zero  to 
a'e  that  finite  difference  gradients  will  be  used.  The  information 

tun.  INFO,  is  initialized  to  zero  and  ADS  is  called  for  optimization. 

the  values  of  the  objective,  OBJ,  and  constraints,  G(I),  I=1,NC0N,  are 
r-d.  control  is  returned  to  the  user  with  INF0=1.  The  functions  are  then 

a  and  ADS  is  called  again.  When  INF0  =  0  is  returned  to  the  user,  the 

i rot  ion  is  complete. 


BEGIN 

V 

DIMENSION  ARRAYS 

l 

DEFINE  BASIC  VARIABLES 

V 

I GRAD  =  0 

i 

f 

INFO  =  0 


l 


Figure  1:  Simplified  Program  Usage;  All  Default 
Parameters  and  Finite  Difference  Gradients 


Figure  2  is  the  program  flow  diagram  for  the  case  where  the  user  wishes  to 
over-ride  one  or  more  internal  parameters,  such  as  convergence  criteria  or 
maximum  number  of  iterations.  Here,  after  initialization  of  basic  parameters 
and  arrays,  the  information  parameter,  INFO,  is  set  to  -2.  ADS  is  then  called 
to  initialize  all  internal  parameters  to  their  default  values  and  allocate 
storage  space  for  internal  arrays.  Control  is  then  returned  to  the  user,  at 
which  point  these  parameters,  for  example  convergence  criteria,  can  be 
over-ridden.  At  this  point,  the  information  parameter,  INFO,  will  have  a  value 
of  -1  and  must  not  be  changed.  ADS  is  then  called  again  and  the  optimization 
proceeds.  Section  4.3  provides  a  list  of  internal  parameters  which  may  be 
modified,  along  with  their  locations  in  the  work  arrays  VK  and  IVK.  A  more 
detailed  explanation  of  these  parameters  is  given  in  Appendix  F. 
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BEGIN 

\f 

DIMENSION  ARRAYS 

\r 

DEFINE  BASIC  VARIABLES 

\f 

IGRAD  =  0 

, 

INFO  =  -2 

I 

CALL  ADS  (INFO  .  .  .  ) 

l 

IF  INF0=0,  EXIT.  ERROR  WAS  DETECTED 

I 

ELSE 

OVER-RIDE  DEFAULT  PARAMETERS  IN 
ARRAYS  V K  AND  IWK  IF  DESIRED 

- CALL  ADS  (INFO  .  .  .  ) 


OBJECTIVE  OPTIMIZATION 

AND  IS  COMPLETE 

CONSTRAINTS 


Figure  2:  Program  Flow  Logic;  Over-ride  Default 
Parameters,  Finite  Difference  Gradients 


Figure  3  is  the  flow  diagram  for  the  case  where  the  user  wishes  to  provide 
gradient  information  to  ADS,  rather  than  having  ADS  calculate  this  information 
using  finite  difference  methods.  In  Figure  3,  it  is  also  assumed  that  the  user 
-'ill  •  :  :  ide  some  internal  parameters,  so  the  difference  between  Figures  2  and 
3  is  ‘hat  1GP.AD  is  now  set  to  1  and  the  user  will  now  provide  gradients  during 
opt  im  i ::  a  *  ion.  If  the  user  does  not  wish  to  over-ride  any  default  parameters, 
INFO  i  ;  initialized  to  zero  and  the  first  call  to  ADS  is  omitted  (as  in  Figure 
1).  Lev,  when  control  is  returned  to  the  user,  the  information  parameter  will 
have  a  value  of  1  or  2  (if  INF0=0,  the  optimization  is  complete,  as  before).  If 
I N FO  = 1 ,  the  objective  and  constraint  functions  are  evaluated  and  ADS  is  called 
again,  just  as  in  Figure  2.  If  INF0  =  2,  the  gradient,  DF,  of  the  objective 
fun  t i on  is  evaluated  as  well  as  the  gradients  of  NGT  constraints  defined  by 
vector  I C . 
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CALL  ADS  (INFO  .  .  .  ) 

if 

IF  INFO=0 ,  EXIT.  ERROR  WAS  DETECTED 
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ARRAYS  VK  AND  IVK  IF  DESIRED 
I 

- >  CALL  ADS  (INFO  .  .  .  ) 


CONSTRAINTS  AND  SPECIFIED 

CONSTRAINTS 

_  - _ - if 


Fig:  »  •  > :  Program  Flow  Logic;  Over-ride  Default 
Parameters  and  Provide  Gradients 
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4.0  USF.R  INSTRUCTIONS 


ecticn ,  use  of  the  AOS  program  is  outlined.  The  FORTRAN  Call 

AOS  is  x  i  von  first,  and  then  the  parameters  in  t  he  calling 
f  i  ne-d  .  *  i  vn  -*.3  idont  i  fies  parameters  that  the  user  -ay  vish 

'  '  -are  :  e  i  fective  use  of  AOS.  Arraus  are  designated  hv 


AOS  is  invoked  by  the  following  FORTRAN  calling  statement  in 


TAIL  ADS  (INFO , ISTRAT , IOPT , IONED , 1  PRINT , IGRAD , NDV , NCON , X, 

*  VLB , VUB , OBJ , G , IDG , NGT , IC , DF , A, NRA , NCOLA ,  VK, NR UK , I UK , NR I UK ) 


'J  T,  £?  r  *  £ 


4.2  Definitions  of  Parameters  in  the  ADS  Calling  Statement 

Table  5  lists  the  parameters  in  the  calling  statement  to  ADS-  Where  arrays 
are  defined,  the  required  dimension  sine  is  given  as  the  array  argument. 

TABLE  5:  PARAMETERS  IN  THE  ADS  ARGUMENT  LIST 

PARAMETER  _  _  _ DEFINITION 

INF'  Information  parameter.  On  the  firs’:  call  to  ADS,  INF0--0  or  -2.  INF0  =  0 

is  used  if  the  user  fines  not  vish  to  over-ride  internal  parameters  and 
INFC---2:  is  used  if  internal  parameters  are  to  be  changed.  When  control 
returns  form  ADS  to  the  calling  program,  INFO  will  have  a  value  of  0, 

1,  or  2.  If  INF0=0,  the  optimization  is  complete.  If  INFO-1,  the  user 
must  evaluate  the  objective,  OBJ,  and  constraint  functions,  G(I), 

1=1, NCON,  and  call  ADS  again.  If  INF0=2,  the  user  must  evaluate  the 
gradient  of  the  objective  and  the  NGT  constraints  identified  by  the 
vector  IC,  and  call  ADS  again.  If  the  gradient  calculation  control, 
IGRAD=0,  INF0=2  will  never  be  returned  from  ADS,  and  all  gradient 
information  is  calculated  by  finite  difference  within  ADS. 

ISTRAT  Optimization  strategy  to  be  used.  Available  options  are  identified  in 
Tables  1  and  4. 

I FT  Optimizer  to  be  used.  Available  options  are  identified  in  Tables  2 
and  4 . 

I-  NED  One-dimensional  search  algorithm  to  be  used.  Available  options  are 
identified  in  Tables  3  and  4. 
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TABLE  5  CONTINUED:  PARAMETERS  IN  THE  ADS  ARGUMENT  LIST 


PARAMETER  DEFINITION 

IPRINT  A  four-digit  print  control.  IPRINT=IJKL  where  I,  J,  K  and  L  have  the 
following  definitions: 

I  ADS  system  print  control. 

0  -  No  print. 

1  -  Print  initial  and  final  information. 

2  -  Same  as  1  plus  parameter  values  and  storage  needs. 

3  -  Same  as  2  plus  scaling  information  calculated  by  ADS. 

J  Strategy  print  control. 

0  -  No  print. 

1  -  Print  initial  and  final  optimization  information. 

2  -  Same  as  1  plus  OBJ  and  X  at  each  iteration. 

3  -  Same  as  2  plus  G  at  each  iteration. 

4  -  Same  as  3  plus  intermediate  information. 

5  -  Same  as  4  plus  gradients  of  constraints. 

K.  Optimizer  print  control. 

0  -  No  print. 

1  -  Print  initial  and  final  optimization  information. 

2  -  Same  as  1  plus  OBJ  and  X  at  each  iteration. 

3  -  Same  as  2  plus  constraints  at  each  iteration. 

4  -  Same  as  3  plus  intermediate  optimization  and  one-dimensional 

search  information. 

5  -  Same  as  4  plus  gradients  of  constraints. 

L  One-Dimensional  search  print  control,  (debug  only). 

0  -  No  print. 

1  -  One-dimensional  search  debug  information. 

2  -  More  of  the  same. 

Example:  IPRINT=3120  corresponds  to  1=3,  J=l,  K=2  and  L=0. 

NOTE:  IPRINT  can  be  changed  at  any  time  control  is  returned  to  the 
user . 

IGRAD  Gradient  calculation  control.  If  IGRAD=0  is  input  to  ADS,  all 

gradient  computations  are  done  within  ADS  by  first  forward  finite 
difference.  If  IGRAD=1,  the  user  will  supply  gradient  information  as 
indicated  by  the  value  of  INFO. 

NDV  Number  of  design  variables  contained  in  vector  X.  NDV  is  the  same  as  n 
in  the  mathematical  problem  statement. 

NCON  Number  of  constraint  values  contained  in  array  G.  NCON  is  the  same 

m+L  in  the  mathematical  problem  statement  given  in  Section  1.0.  NC0N=0 
is  allowed. 

X(NDV+1)  Vector  containing  the  design  variables.  On  the  first  call  to  ADS, 
this  is  the  user's  initial  estimate  to  the  design.  On  return  from  ADS, 
this  is  the  design  for  which  function  or  gradient  values  are  required. 
On  the  final  return  from  ADS  (INF0=0  is  returned),  the  vector  X 
contains  the  optimum  design. 
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TABLE  5  CONTINUED:  PARAMETERS  IN  THE  ADS  ARGUMENT  LIST 


PARAMETER  DEFINITION 

VLB;  .'.TV- 1  )  Array  containing  lover  bounds  on  the  design  variables,  X.  If  no 
lover  bounds  are  imposed  on  one  or  more  of  the  design  variables,  the 
..or  res  ponding  component  (s)  of  VLB  must  be  set  to  a  large  nega ' :  ve 

,:~bs  r  .  sav  -  1  1  5  . 

V’u'B  *  Array  containing  upper  bounds  on  the  design  variables .  X.  I: 

upper  rounds  are  imposed  on  one  or  more  of  the  design  mar  table  .  .  ' 
corresponding  ccmponent(s)  of  VUB  must  be  set  to  a  large  positive 
number,  say  1. OS-15. 

OBJ  Value  of  the  objective  function  cor respond i ng  to  the  current  values  of 
the  design  variables  contained  in  X.  On  the  first  call  to  ADS.  OBJ 
need  not  be  defined.  ADS  vill  return  a  value  of  INF0=1  to  indicate 
that  the  user  must  evaluate  OBJ  and  call  ADS  again.  Subsequently,  any 
time  a  value  of  INF0=1  is  returned  from  ADS,  the  objective,  OBJ,  must 
be  evaluated  for  the  current  design  and  ADS  must  be  called  again.  OBJ 
has  the  same  meaning  as  F(X)  in  the  mathematical  problem  statement 
given  in  Section  1.0. 

G(NCON)  Array  containing  NCON  constraint  values  corresponding  to  the  current 
design  contained  in  X.  On  the  first  call  to  fi'j S,  the  constraint  values 
need  not  be  defined.  On  return  from  ADS,  if  INF0=1,  the  constraints 
must  be  evaluated  for  the  current  X  and  ADS  called  again.  If  NCQN=0, 
array  G  should  be  dimensioned  to  unity,  but  no  constraint  values  need 
to  be  provided. 

IDG (NCON)  Array  containing  identifiers  indicating  the  type  of  the  constraints 
contained  in  array  G. 

IDG(I)  =  -2  for  linear  equality  constraint. 

IDG(I)  =  -1  for  nonlinear  equality  constraint. 

IDG(I)  =  0  or  1  for  nonlinear  inequality  constraint. 

IDG(I)  =  2  for  linear  inequality  constraint. 

NGT  Number  of  constraints  for  which  gradients  must  be  supplied.  NGT  is 

defined  by  ADS  as  the  minimum  of  NCOLA  and  NCON  and  is  returned  to  the 
user . 

IC(NCT)  Array  identifying  constraints  for  vhich  gradients  are  required.  IC 
is  defined  by  ADS  and  returned  to  the  user.  If  INF0=2  is  returned  to 
the  user,  the  gradient  of  the  objective  and  the  NGT  constraints  must  be 
'evaluated  and  stored  in  arrays  DF  and  A,  respectively,  and  ADS  must  be 
called  again. 

DF(NDV-l)  Array  containing  the  gradient  of  the  objective  corresponding  to  the 
current  X.  Array  DF  must  be  defined  by  the  user  vhen  INF0=2  is 
returned  from  ADS.  This  vill  not  occur  if  IGRAD=0,  in  vhich  case  array 
DP  is  evaluated  by  ADS. 
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TABLE  5  CONCLUDED:  PARAMETERS  IN  THE  ADS  ARGUMENT  LIST 


PARAMETER _ _ DEFINITION 

A(NRA.NCOLA)  Array  containing  the  gradients  of  the  NGT  constraints  identified 
by  array  IC.  That  is,  column  J  of  array  A  contains  the  gradient  of 
constraint  number  K,  where  K=IC(J).  Array  A  must  be  defined  by  the 
user  when  INF0=2  is  returned  from  ADS  and  when  NGT.GT.O.  This  will  not 
occur  if  IGRAD=0,  in  which  case,  array  A  is  evaluated  by  ADS.  NRA  is 
the  dimensioned  rows  of  array  A.  NCOLA  is  the  dimensioned  columns  of 
array  A. 

NRA  Dimensioned  rows  of  array  A.  NRA  must  be  at  least  NDV+1. 

NCOLA  Dimensioned  columns  of  array  A.  NCOLA  should  be  at  least  the  minimum 
of  NCON  and  2*NDV.  If  enough  storage  is  available,  and  if  gradients 
are  easily  provided  or  are  calculated  by  finite  difference,  then 
NC0LA=NC0N+NDV  is  ideal. 

VK(NRVK)  User  provided  work  array  for  real  variables.  Array  VK  is  used  to 
store  internal  scalar  variables  and  arrays  used  by  ADS.  VK  must  be 
dimensioned  at  least  100,  but  usually  much  larger.  If  the  use  has  not 
provided  enough  storage,  ADS  will  print  the  appropriate  message  and 
terminate  the  optimization. 

NRVK  Dimensioned  size  of  work  array  VK.  A  good  estimate  is 

NRVK  =  500  +  10*(NDV+NC0N)  +  NC0LA*(NC0LA+3)  +  N*(N/2+l),  where 
N  =  MAX(NDV, NCOLA) . 

IVK(NRIVK)  User  provided  work  array  for  integer  variables.  Array  IVK  is 

used  to  store  internal  scalar  variables  and  arrays  used  by  ADS.  IVK 
must  be  dimensioned  at  least  200,  but  usually  much  larger.  If  the  user 
has  not  provided  enough  storage,  ADS  will  print  the  appropriate 
message  and  terminate  the  optimization. 

NRIVK  Dimensioned  size  of  work  array  IVK.  A  good  estimate  is  NRIVK  =  200  * 
NDV  +  NCON  +  N  +  MAX(N, 2*NDV) ,  where  N=MAX(NDV, NCOLA) . 


4.3  Over-Riding  ADS  Default  Parame ters 

Various  internal  parameters  are  defined  on  the  first  call  to  ADS  which  work 
well  for  the  "average"  optimization  task.  However,  it  is  often  desirable  to 
change  these  in  order  to  gain  maximum  utility  of  the  program.  This  mode  of 

operation  is  shown  in  Figures  2  and  3.  After  the  first  call  to  ADS,  various 

real  and  integer  scalar  parameters  are  stored  in  arrays  VK  and  IVK  respectively. 

Those  which  the  user  may  wish  to  change  are  listed  in  Tables  6  through  9, 

together  with  their  default  values  and  definitions.  If  the  user  wishes  to 
change  any  of  these,  the  appropriate  component  of  VK  or  IVK  is  simply  re-defined 
after  the  first  call  to  ADS.  For  example,  if  the  relative  convergence 
criterion,  DEL0BJ,  is  to  be  changed  to  0.002,  this  is  done  with  the  FORTRAN 
statement ; 

VK( 12 )  =  0.002 

because  VK(12)  contains  the  value  of  DEL0BJ. 
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TABLE  b:  REAL  PARAMETERS  STORED  IN  ARRAY  VK 

HODULES  WHERE  USED 


PARAMETER  LOCATION  DEFAULT 

I STRAT 

I  OPT 

IONED 

'  _*4 

1 

0.0 

5 

_ 

_ 

3F.TA.MC: 

2 

0.0 

7 

- 

- 

ctc  : ) 

3 

-0.03 

- 

4,5 

- 

C7L 

4 

-0.005 

- 

4,5 

- 

•  ».( -»■ » ■ 

5 

0.001 

- 

4,5 

- 

r""  m  ” 

6 

0 . 004 

- 

4,5 

- 

Da*.  ;;  ^  ) 

7 

0.0001 

- 

ALL 

P  V  ’ 

3 

ABS( FZ) / 1000 

ALL 

- 

p  ;;  p.  7:  u 

1 

ABS(FZ)/500 

ALL 

- 

- 

^  .*.  73  c;  -  p 

10 

ABS(FZ)/1000 

ALL 

- 

p  P  ;  ;4  •  p  ;  1  \ 

1  - 

0 . 005 

- 

- 

1,2, 5 . 6 

p  P  I  p  P,  * 

1  iL 

0.001 

- 

ALL 

p  p  •  p. ::  u 

13 

0.01 

ALL 

- 

- 

dels:?. 

14 

0.001 

ALL 

- 

- 

DLOBj 1 

15 

0.1 

- 

ALL 

- 

DL03J2 

16 

1000.0 

- 

ALL 

- 

DX1 

17 

0.01 

- 

ALL 

- 

DX2 

18 

0.2 

- 

ALL 

- 

EPS PEN 

19 

-0.05 

2,3,4 

- 

- 

EXTRAP 

20 

5.0 

- 

- 

ALL 

FDCH 

21 

0.01 

- 

ALL 

- 

FDCHM 

22 

0.001 

- 

ALL 

- 

GMULTZ 

23 

10.0 

8 

- 

- 

PSAIZ 

24 

0.95 

8 

- 

- 

RMULT 

25 

5.0 

1,5 

- 

- 

RMVLMZ(4) 

26 

0.2 

6, 7, 8, 9 

- 

- 

RP 

27 

10.0 

1,5 

- 

- 

RPMAX 

28 

1.0E+10 

1,5 

- 

- 

RPMULT 

29 

0.2 

1,5 

- 

- 

RPPMIN 

30 

1.0E-10 

2,3,4 

- 

- 

RPPRIM 

31 

100.0 

2,3,4 

- 

- 

SCFO 

32 

1.0 

ALL 

ALL 

ALL 

SCLMIN 

33 

0.001 

ALL 

ALL 

ALL 

STOL 

34 

0.001 

- 

4,5 

- 

THETAZ 

35 

0.1 

- 

4,5 

- 

XMIJLT 

36 

2.618034 

- 

- 

1,2, 3, 5, 6, 7 

ZRO 

37 

0.00001 

ALL 

ALL 

ALL 

PMLT 

38 

10.0 

6, 7, 8, 9 

4,5 

- 

1  If  IOPT=4 

,  CT 

=  -0.1 

2  If  IONED= 

3  or 

8,  DABALP=0 . 001 

3  If  IONED= 

3  or 

8,  DELALP=0 . 05 

4  I f  I STRAT 

=  9, 

RMVLMZ=0 . 4 

NOTE:  FZ  is 

the 

objective  function 

value  for 

the  initial 

design . 
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TABLE  7:  DEFINITIONS  OF  REAL  PARAMETERS  CONTAINED  IN  ARRAY  VK 


PARAMETER  _ 

ALAMDZ  Initial  estimate  of  the  Lagrange  Multipliers  in  the  Augmented  Lagrange 
Mu'!  tiplier  Method. 

BETAMC  Additional  steepest  descent  fraction  in  the  method  of  centers.  After 
moving  to  the  center  of  the  hypersphere,  a  steepest  descent  move  is 
made  equal  to  BETAMC  times  the  radius  of  the  hypersphere. 

CT  Constraint  tolerance  in  the  Method  of  Feasible  Directions  or  the 

Modified  Method  of  Feasible  Directions.  A  constraint  is  active  if  its 
numerical  value  is  more  positive  than  CT. 

CTL  Same  as  CT,  but  for  linear  constraints. 

CTLMIN  Same  as  CTMIN,  but  for  linear  constraints. 

CTMIN  Minimum  constraint  tolerance  for  nonlinear  constraints.  If  a 
constraint  is  more  positive  than  CTMIN,  it  is  considered  to  be 
violated . 

DABALP  Absolute  convergence  criteria  for  the  one-dimensional  search  when 
using  the  Golden  Section  method. 

DABOBJ  Maximum  absolute  change  in  the  objective  between  two  consecutive 
iterations  to  indicate  convergence  in  optimization. 

DABOBM  Absolute  convergence  criterion  for  the  optimization  sub-problem  when 
using  sequential  minimization  techniques. 

DABSTR  Same  as  DABOBJ,  but  used  at  the  strategy  level. 

DELALP  Relative  convergence  criteria  for  the  one-dimensional  search  when 
using  the  Golden  Section  method. 

DELOBJ  Maximum  relative  change  in  the  objective  between  two  consecutive 
iterations  to  indicate  convergence  in  optimization. 

DELOBM  Relative  convergence  criterion  for  the  optimization  sub-problem  when 
using  sequential  minimization  techniques. 

DELSTR  Same  as  DELOBJ,  but  used  at  the  strategy  level. 

DL0BJ1  Relative  change  in  the  objective  function  attempted  on  the  first 

optimization  iteration.  Used  to  estimate  initial  move  in  the  one¬ 
dimensional  search.  Updated  as  the  optimization  progresses. 

DL0BJ2  Absolute  change  in  the  objective  function  attempted  on  the  first 

optimization  iteration.  Used  to  estimate  initial  move  in  the  one¬ 
dimensional  search.  Updated  as  the  optimization  progresses. 

DX1  Maximum  relative  change  in  a  design  variable  attempted  on  the  first 

optimization  iteration.  Used  to  estimate  the  initial  move  in  the  one¬ 
dimensional  search.  Updated  as  the  optimization  progresses. 

DX2  Maximum  absolute  change  in  a  design  variable  attempted  on  the  first 

optimization  iteration.  Used  to  estimate  the  initial  move  in  the  one¬ 
dimensional  search.  Updated  as  the  optimization  progresses. 

EPSPEN  Initial  transition  point  for  extended  penalty  function  methods. 

Updated  as  the  optimization  progresses. 

EXTRAP  Maximum  multiplier  on  the  one-dimensional  search  parameter,  ALPHA  in 
the  one-dimensional  search  using  polynomial  interpolation  and 
ex  t  rapolat ion . 

FDCH  Relative  finite  difference  step  when  calculating  gradients. 

FDCHM  Minimum  absolute  value  of  the  finite  difference  step  when  calculating 
gradients.  This  prevents  too  small  a  step  when  X(I)  is  near  zero. 


TABLE  /  CONCLUDED:  DEFINITIONS  OF  REAL  PARAMETERS  CONTAINED  IN  ARRAY  VK 


PARAMF 

■’.TER 

r;  u ; 1  ’  ” 

pc  ;  r  ' 

al 

on 


Programming . 


DEFINITION 

y  parameter  in  Sequential  Quadratic  programming, 
to  avoid  constraint  violations  in  Sequential  Quadratic 


RMULT  Penalty  function  multiplier  for  the  exterior  penalty  function  method. 
Must  be  greater  than  1.0. 

P.M7LMZ  Initial  relative  move  limit.  Used  to  set  the  move  limits  in 

sequential  linear  programming,  method  of  inscribed  hyperspheres  and 
sequential  quadratic  programming  as  a  fraction  of  the  value  of  X(I), 
1=1, NDV . 


RPMl'LT 
RRPM1N 
R  v  ?  R I M 

SCF  (■• 

SL'LM  I N 


XNULT 

ZRO 


p  V ;  T 


Initial  penalty  parameter  for  the  exterior  penalty  function  method  or 
the  Augmented  Lagrange  Multiplier  method. 

Maximum  value  of  RP  for  the  exterior  penalty  function  method  or  the 
Augmented  Lagrange  Multiplier  method. 

Multiplier  on  RP  for  consecutive  iterations. 

Minimum  value  of  RPPRIM  to  indicate  convergence. 

Initial  penalty  parameter  for  extended  interior  penalty  function 
me  thods . 

The  user-supplied  value  of  the  scale  factor  for  the  objective  function 
if  the  default  or  calculated  value  is  to  be  over-ridden. 

Minimum  numerical  value  of  any  scale  factor  allowed. 

Tolerance  on  the  components  of  the  calculated  search  direction  to 
indicate  that  the  Kuhn-Tucker  conditions  are  satisfied. 

Nominal  value  of  the  push-off  factor  in  the  Method  of  Feasible 
Directions . 

Multiplier  on  the  move  parameter,  ALPHA,  in  the  one-dimensional  search 
to  find  bounds  on  the  solution. 

Numerical  estimate  of  zero  on  the  computer.  Usually  the  default  value 
is  adequate.  If  a  computer  with  a  short  word  length  is  used, 
ZR0=1.0E-4  may  be  preferred. 

Penalty  multiplier  for  equality  constraints  when  I0PT=4  or  5. 


TABLE  8:  INTEGER  PARAMETERS  STORED  IN  ARRAY  IVK 

MODULES  VHERE  USED 


PARAMETER  LOCATION 

DEFAULT 

ISTRAT 

IOPT 

IONED 

: ■ :  ••  i 

NDV  -  1 

_ 

ALL 

_ 

yj  ;  2 

l 

ALL 

ALL 

ALL 

r  -  U  V 

AO 

- 

ALL 

- 

MFM'.r 

- 

1.2,3 

- 

: TP M VT 

ALL 

- 

'  ' ,  *  ’  f , 

I  •  .‘NFD 

8 

- 

- 

■  ’  Ll 

i  ( . 

al: 

- 

- 
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TABLE  9:  DEFINITIONS  OF  INTEGER  PARAMETERS  CONTAINED  IN  ARRAY  IVK 
PARAMETER^  DEFINITION 

ICNDIR  Restart  parameter  for  conjugate  direction  and  variable  metric  methods. 
Unconstrained  minimization  is  restarted  with  a  steepest  descent 
direction  every  ICNDIR  iterations. 

ISCAL  Scaling  parameter.  If  ISCAL=0,  no  scaling  is  done.  If  ISCAL=1,  the 
design  variables,  objective  and  constraints  are  scaled  automatically. 

UMAX  Maximum  number  of  iterations  allowed  at  the  optimizer  level. 

ITRMOP  The  number  of  consecutive  iterations  for  which  the  absolute  or 

relative  convergence  criteria  must  be  met  to  indicate  convergence  at 
the  optimizer  level. 

ITRMST  The  number  of  consecutive  iterations  for  which  the  absolute  or 

relative  convergence  criteria  must  be  met  to  indicate  convergence  at 
the  strategy  level. 

JONED  The  one-dimensional  search  parameter  (IONED)  to  be  used  in  the 
Sequential  Quadratic  Programming  method  at  the  strategy  level. 

JTMAX  Maximum  number  of  iterations  allowed  at  the  strategy  level. 

4.4  User-Supplied  Gradients 

If  it  is  convenient  to  supply  analytic  gradients  to  ADS,  rather  than  using 
internal  finite  difference  calculations,  considerable  optimization  efficiency  is 
attainable.  If  the  user  wishes  to  supply  gradients,  the  flow  logic  given  in 

Figure  3  is  used.  In  this  case,  the  information  parameter,  INFO,  will  be 

returned  to  the  user  with  a  value  of  INF0=2  when  gradients  are  needed.  The  user 
calculates  the  NGT  gradients  of  the  constraints  identified  by  array  IC  and 
stores  these  in  the  first  NGT  columns  of  array  A.  That  is  column  I  of  A 

contains  the  gradient  of  constraint  J,  where  J=IC(I). 


4.5  Restarting  ADS 

When  solving  large  and  complex  design  problems,  or  when  multi-level 
optimization  is  being  performed,  it  is  often  desirable  to  terminate  the 
optimization  process  and  restart  from  that  point  at  a  later  time.  This  is 
easily  accomplished  using  the  ADS  program.  Figure  4  provides  the  basic 
flowchart  for  this  process.  Whenever  control  is  returned  from  ADS  to  the 
calling  program,  the  entire  contents  of  the  parameter  list  are  written  to  disk 
(or  a  file  in  a  database  management  system).  The  program  is  then  stopped  at 
this  point.  Later,  the  program  is  restarted  by  reading  the  information  back 
from  disk  and  continuing  from  this  point.  If  optimization  is  performed  as  a 
sub-problem  within  analysis,  the  information  from  the  system  level  optimization 
is  written  to  disk  and  the  analysis  is  called.  The  analysis  module  can  then 
call  ADS  to  perform  the  sub-optimization  task.  Then,  upon  return  from  analysis, 
the  system  level  information  is  read  back  from  storage  and  the  optimization 
proceeds  as  usual.  From  this,  it  is  seen  that  considerable  flexibility  exists 
for  multi-level  and  multi-discipline  optimization  with  ADS,  where  the  ADS 
program  is  used  for  multiple  tasks  within  the  overall  design  process. 
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The  user  may  wish  to  stop  the  optimization  at  specific  times  during  the 
process.  The  parameter  IMAT  is  array  IVK  gives  general  information  regarding 
the  progress  of  the  optimization.  Appendix  B  provides  details  of  this  parameter 
as  veil  as  other  parameters  stored  in  VK  and  IWK  which  may  be  useful  to  the 

exper  :  «:;ce i  user  of  ADS. 


BEGIN 


Figure  4:  Restarting  ADS 


4.6  Choosing  An  Algorithm 

One  difficulty  with  a  program  such  as  ADS,  which  provides  numerous  options, 
is  that  of  picking  the  best  combination  of  algorithms  to  solve  a  given  problem. 
While  it  is  not  possible  to  provide  a  concise  set  of  rules,  some  general 
guidelines  are  offered  here  based  on  the  author's  experience.  The  user  is 
strongly  encouraged  to  try  many  different  options  in  order  to  gain  familiarity 
with  ADS  and  to  improve  the  probability  that  the  best  combination  of  algorithms 
is  found  for  the  particular  class  of  problems  being  solved. 


UNCONSTRAINED  FUNCTIONS  (NC0N=0,  Side  Constraints  OK) 

ISTRAT=0 

Is  computer  storage  very  limited? 

Yes  -  I0PT=1.  Are  function  evaluations  expensive? 

Yes  -  Is  the  objective  known  to  be  approximately  quadratic? 

Yes  -  I0NED=4 
No  -  I0NED=3 
No  -  I0NED=1  or  2 
No  -  Is  the  analysis  iterative? 

Yes  -  I0PT=3.  Are  function  evaluations  expensive? 

Yes  -  Is  the  objective  known  to  be  approximately  quadratic? 

Yes  -  I0NED=4 
No  -  I0NED=3 
No  -  I0NED=1  or  2 

No  -  I0PT=2  or  3.  Are  function  evaluations  expensive? 

Yes  -  Is  the  objective  known  to  be  approximately  quadratic? 

Yes  -  I0NED=4 
No  -  I0NED=3 
No  -  I0NED=1  or  2 

CONSTRAINED  FUNCTIONS  (NCON.GT.O) 

Are  relative  minima  known  to  exist? 

Yes  -  ISTRAT=1,  I0PT=3.  Are  function  evaluations  expensive? 

Yes  -  I0NED=3 
No  -  I0NED=1  or  2 

No  -  Are  the  objective  and/or  constraints  highly  nonlinear? 

Yes  -  Are  function  evaluations  expensive? 

Yes  -  ISTRAT=0 ,  I0PT=4,  I0NED=7 

No  -  ISTRAT=2 ,  3  or  5,  I0PT=2  or  3,  I0NED=1  or  2 
No  -  Is  the  design  expected  to  be  fully-constrained? 

(i.e.  NDV  active  constraints  at  the  optimum) 

Yes  -  ISTRAT=6 ,  I0PT=5,  I0NED=6 
No  -  Is  the  analysis  iterative? 


Yes 

-  ISTRAT=0, 

IOPT=4 , 

I0NED=7 

or 

ISTRAT=8 , 

I0PT=5 , 

I0NED=7 

or 

ISTRAT=9 , 

I0PT=5 , 

I0NED=7 

No 

-  ISTRAT=0, 

I0PT=5 , 

I0NED=7 

or 

ISTRAT=8 , 

I0PT=5 , 

I0NED=7 

or 

ISTRAT=9 , 

I0PT=5 , 

I0NED=7 
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■  'f  ten  little  is  knovn  about  the  nature  of  the  problem  being  solve'!.  S  u.-f-d 
on  experience  v i t  h  a  vide  variety  of  problems,  a  very  direct  approach  i  •;  given 
hero  :  using  ADS.  The  following  table  of  parameters  is  offered  as  a  -^quence 
of  a  1/ :  t  hms  .  Vhen  using  ADS  the  first  few  times,  the  user  may  p:  «s  »•:  to  r  :r. 
the  rare:  given  here,  rather  than  using  the  decision  approach  giver,  ano-e.  It 
is  here  that  a  constrained  optimization  problem  is  being  solved.  if  the 


prchlem  is  unconstrained,  ISTRAT=0,  I0PT=3  and  I0NED=2  or  3  is  recommended > 

1 5 TEAT  IOPT _ IONED 

5  7  2200 

3  7  2020 

7  2020 

5  "  2200 

•  (.  2  200 

3  3  2200 

3  3  2200 

3  3  2200 


5.0  EXAMPLES 

i  tier  "he  following  two-variable  optimization  problem  with  two  nonlinear 
c  o  r. t  r  ■.  t  st;: 

Minimize  OBJ  .=  ?>SQRT(2)+A1  -  A2 

2  *A1  +  SQRT( 2 ) *A2 

yr:  l  to;  Gfl)  - -  -  1  ,  LE.  0 

r-Al*[Al  •  SQRT ( 2 ) * A2 j 


0(2)  -  -  -  1  .LE.  0 

2  MAI  *  SORT  (  2 )  *rA2  ] 


0.01  .LE.  Ai  .LE.  1.0E4-20  i  =  1 , 2 

This  is  actually  the  optimization  of  the  classical  3-bar  truss  shown  in  Figure 
where,  for  simplicity,  only  the  tensile  stress  constraints  in  members  1  and 
under-  load  PI  are  included.  The  loads,  PI  and  P  2 ,  are  applied  separately  and 
"he  ~a"erial  specific  weight  is  0.1  lb.  per  cubic  inch.  The  structure  is 
required  to  he  symmetric  so  X(  1)  corresponds  to  the  cross-sectior.al  area  of 
memijet:;  1  and  3  and  X(2)  corresponds  to  the  cross-sectional  area  of  member  2. 


(V 

o 


l/l  C'4 


Figure  5:  Three-Bar  Truss 


In  the  source  listings  for  the  examples,  the  arrays  are  dimensioned 
sufficiently  large  to  solve  10  design  variable  problems  with  20  constraints. 
This  allows  the  user  to  create  larger  problems  using  these  programs  as  a  basis. 
Note  that  the  required  array  dimensions  given  in  this  manual  are  minimums ■  The 
arrays  can  be  dimensioned  larger  than  needed,  just  as  is  done  here. 


5.1  Example  1;  All  Default  Parameters 

Figure  6  gives  the  FORTRAN  program  to  be  used  with  ADS  to  solve  this 
problem.  Only  one  line  of  data  is  read  by  this  program  to  define  the  values  of 
ISTRAT,  I0PT,  IONED  and  IPRINT  and  the  FORMAT  is  415.  When  the  optimization  is 
complete,  another  case  may  be  run  by  reading  a  new  set  ol  data.  The  program 
terminates  when  ISTRAT=-1  is  read  as  data. 

Figure  7  gives  the  results  obtained  with  ISTRAT=0,  I0PT=5,  I0NED=7  and 
IPRINT=1000.  The  reader  is  encouraged  to  experiment  with  this  program  using 
various  combinations  of  the  options  from  Table  4. 

5.2  Example  2;  Initial  Parameters  Are  Modified 

The  3-bar  truss  designed  in  Section  5.1  is  now  designed  with  the  following 
changes  in  the  internal  parameters: 


Parameter  New  Value  Location  in  UK  Location  in  IVK 


CT  -0.05  3 
CTMIN  0.001  6 
FDCH  0.001  21 
ITRM0P  2 

The  FORTRAN  program  used  here  is 
given  in  Figure  9. 


4 

shown  in  Figure  8  and  the  results  are 
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.  3  Example  3;  Gradients  Supplied  by  the  User 


The  3 -bar  truss  designed  in  Sections  5 . 1  and  3..’ 
ser-suppiied  gradients.  The  parameters  CT,  CTMIN,  CTMIN 
vet'-t  idden  as  in  Section  5.2.  Also,  nov  I  PRINT -2020  to 
- v e 1  ot  optimisation  output. 

The  FORTRAN  program  associated  vitli  this  example 
igure  11  gives  the  results. 


MC.si 

:  •  t :  e  v 

i  t  h 

':i!i TAZ  an.: 

; 2RM0P 

are 

nvi:l(j  a 

■:  :  ;  t  y  p  i 

Cal 

given  in 

r  i  g  u  r  e 

10. 

C  SIMPLIFIED  USAGE  OF  ADS.  THE  THREE-BAR  TRUSS. 

C  REQUIRED  ARRAYS. 

DIMENSION  X( 11 ) , VLB(ll) ,VUB(11) ,C(20) , IDG (20) , IC(20) ,DF(1 1 ) , 

1  A ( 1 1 , TO ) . UK ( 1 000 ) , 1 UK ( 500 ) 

C  ARRAY  DIMENSIONS. 

NRA  -2 
NCOLA-2 
NRVK= 1000 
NRIVK=500 
C  PARAMETERS. 

IGRAD^O 
NDV  =  2 
NC0N=2 

C  INITIAL  DESIGN. 

X  ( 1 )  =  1  • 

X  (  2 )  =  1 . 

C  BOUNDS. 

VLB( 1 ) = . 01 
VLB ( 2 ) - .01 
VUB( 1 ) =1 . 0E  +  20 
VUB( 2 ) = 1 . 0E+20 

C  IDENTIFY  CONSTRAINTS  AS  NONLINEAR,  INEQUALITY. 

I DG ( 1 )  =  0 
I DG ( 2 )  =0 
C  INPUT. 

READ ( 5 , 30 )  I STRAT , IOPT , IONED , I  PRINT 
C  OPTIMIZE. 

INFO=0 

10  CALL  ADS  (INFO, ISTRAT, IOPT, IONED , I  PRINT , IGRAD , NDV , NCON , X , VLB, 
1  VUB  ,  OB  J  ,  C, ,  I  DG  ,  NGT  ,  IC ,  DF ,  A ,  NRA ,  NCOLA  ,  UK ,  NRWK ,  IWK ,  NRI UK ) 

IF  (INFO.EQ.O)  GO  TO  20 
C  EVALUATE  OBJECTIVE  AND  CONSTRAINTS. 

0BJ=2 . *5QRT ( 2 . )*X(1)+X(2) 

G(1)=(2.*X(1)+SQRT(2. )*X(2))/(2.*X(1)*(X(1)+SQRT(2. )*X(2)))-1 
G( 2 )= . 5/ (X( 1 )+SQRT( 2 . )*X(2))-1. 

C  GO  CONTINUE  WITH  OPTIMIZATION. 

GO  TO  10 
20  CONTINUE 

C  PRINT  RESULTS. 

VRITE(6 , 40)  OBJ,X(l),X(2),G(l),G(2) 

STOP 

30  FORMAT  (415) 

40  FORMAT  ( / / 5X , 7H0PTIMUM , 5X , 5H0BJ  = ,  E12 . 5//5X, 6HX( 1 )  =,E12.5,5X 
1  6  H  X ( 2 )  = , E12 . 5/5X , 6HG( 1 )  = , E12 . 5 , 5X , 6HG( 2 )  =,E12.5) 

END 


Figure  6:  Example  1  -  All  Default  Parameters 
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DDDDDD  SSSSSS 

D  D  S 

D  D  S 

D  D  SSSSS 

D  D  S 

D  D  5 

DDDDDD  SSSSSS 


FORTRAN  PROGRAM 
FOR 

AUTOMATED  DESIGN  SYNTHESIS 

(C)  COPYRIGHT,  EDO,  INC.,  1987 
ALL  RIGHTS  RESERVED,  WORLDWIDE 

VERSION  3.00 

CONTROL  PARAMETERS 

ISTRAT  =  0  IOPT  =  5  IONED  =  I  IPRINT  =  1000 

IGRAD  =  0  NDV  =  2  NCON  =  2 


OPTIMIZATION  RESULTS 


AAAAA 
A  A 

A  A 

AAAAAAA 


OBJECTIVE  FUNCTION  VALUE  2 . 62899E*0O 


DESIGN  VARIABLES 


LOWER 

VARIABLE 

BOUND 

VALUE 

1 

1 . 00000E-02 

7 . 82696E-01 

2 

1 . 00000E-02 

4 . 15190E-01 

UPPER 

BOUND 

1 . 00000E+20 
1.00000E+20 


DESIGN  CONSTRAINTS 

1)  3.8170E-03  -6 . 3500E-01 

FUNCTION  EVALUATIONS  =  26 


OPTIMUM  OBJ  -  . 26290E+01 

X(l)  -  . 78270E+00  X(2)  =  .41515E+00 

G ( 1 )  :  . 38170E-02  G(2)  =  -.63500E*00 

Figure  7:  Example  1  -  Output 
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C  USAGE  OF  ADS.  OVER-RIDING  DEFAULT  PARAMETERS.  THE  THREE-BAR  TRUSS. 
DIMENSION  X( 11 ) ,VLB(11) ,VUB(11) ,G( 20) ,IDG(20) ,IC(20) , DF( 1 1 ) , 

1  A(11,20),WK( 1000) , IVK(500) 

C  ARRAY  DIMENSIONS. 

NRA=2 
NC0LA=2 
NRVK=1000 
NRIVK=50 0 
C  PARAMETERS. 

IGRAD=0 

NDV=2 

NC0N=2 

C  INITIAL  DESIGN. 

X( 1  )  =  1 • 

X(2)=l. 

C  BOUNDS. 

VLB( 1 )= . 01 
VLB(2)=.01 
VUB( 1 ) =1 . 0E+20 
VUB(2)=1 . 0E+20 

C  IDENTIFY  CONSTRAINTS  AS  NONLINEAR,  INEQUALITY. 

IDG( 1 ) =0 
IDG(2)=0 
C  INPUT. 

READ (5 , 30 )  I STRAT , IOPT , IONED , I PRINT 
C  INITIALIZE  INTERNAL  PARAMETERS. 

INF0=-2 

CALL  ADS  ( INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD, NDV, NCON , X , VLB, 

1  VUB , OBJ ,G, IDG , NGT , IC, DF , A, NRA, NCOLA, VK, NRVK, IVK,NRIVK) 

C  OVER-RIDE  DEFAULT  VALUES  OF  CT,  CTMIN,  THETAZ  AND  ITRMOP. 

VK(3)=-0.05 
VK(6)=0.001 
WK(21)=0.00I 
IVK(4)=2 
C  OPTIMIZE. 

10  CALL  ADS  (INFO, I STRAT, IOPT, IONED, I PRINT, IGRAD, NDV, NCON,  X,  VLB, 

1  VUB, OBJ, G, IDG, NGT, IC,DF, A, NRA, NCOLA, VK, NRVK, IVK.NRIVK) 

IF  (INFO.EQ.O)  GO  TO  20 
C  EVALUATE  OBJECTIVE  AND  CONSTRAINTS. 

OBJ =2 . *SQRT (2.)*X(1)+X(2) 

G(1)=(2.*X(1)+SQRT(2.)*X(2))/(2.*X(1)*(X(1)+SQRT(2. )*X(2)))-1. 

G( 2 )= . 5/(X( 1 )+SQRT(2 . )*X(2))-1. 

C  GO  CONTINUE  WITH  OPTIMIZATION. 

GO  TO  10 
20  CONTINUE 

C  PRINT  RESULTS. 

VRITE(6,40)  OBJ,X(l),X(2),G(l),G(2) 

STOP 

30  FORMAT  (415) 

40  FORMAT  ( //5X, 7H0PTIMUM , 5X , 5H0BJ  = , E12 . 5//5X , 6HX( 1 )  =,E12.5,5X, 

1  6HX(2)  = , E12 . 5/5X, 6HG( 1)  =,E12  5,5X,6HG(2)  =,E12.5) 

END 

Figure  8:  Example  2  -  Modify  Default  Parameters 
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ORTRAN  PR 

OCR 

A  M 

FOR 

A  T 

ED  D  E  S  I  G 

N  S 

Y  N 

(C) 

COPYPIGHT,  EDO, 

INC.  , 

1987 

ALL 

RIGHTS  RESERVED, 

VORLDVIDE 

VERSION 

3.00 

CONTROL  PARAMETERS 
ISTRAT  =  0  IOFT 

_ 

5 

IONED  = 

7 

I PR I NT  -  in.'! 

IGRAD  =  0  NDV 

= 

2 

NCON 

i 

OPTIMIZATION  RESULTS 


OBJECTIVE  FUNCTION  VALUE  2.63726E+00 


I 

i 


DESIGN  VARIABLES 


VARIABLE 

1 

2 


LOVER 

BOUND 

1 .00000E-02 
i .00000E-02 


VALUE 

7.86349F.-01 
4. 13130E-01 


UPPER 

BOUND 

1 . 00000E+20 
1 .00000E*20 


DESIGN  CONSTRAINTS 

1)  6 . 5273E-04  -6.3520E-01 


FUNCTION 

EVALUATIONS 

29 

OPTIMUM 

OBJ  =  . 

2637  3E+01 

X(  1 )  =  . 

G(l)  - 

78635E+00 
,  65273E-03 

X(2)  = 
G(2)  = 

.  41313E+00 
■  63520E+00 

F  igure  9 

:  Example  2 

-  Output 

2  7 
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USAGE  OF  ADS.  OVER-RIDING  DEFAULT  PARAMETERS,  AND  PROVIDING 
GRADIENTS.  THE  THREE-BAR  TRUSS. 

REQUIRED  ARRAYS. 

DIMENSION  X(ii),VLB(:i) ,VUB(11) ,G(20) ,IDC(29) ,!C(20) ,DF(11) . 

1  A( 1 1 , 20) ,  WK( 1000) , IVK(500) 

DIMENSION  B( 2 , 2  ) 

ARRAY  DIMENSIONS. 

NRA=2 
NC0LA=2 
NRVK=1000 
NRIVK=500 
PARAMETERS. 

IGRAD=1 
NDV=2 
NC0N=2 

INITIAL  DESIGN. 

X(l)=l. 

X(2)=l. 

BOUNDS. 

VLB( 1 ) = . 01 
VLB(2)=.01 
VUB( 1)=1 . 0E+20 
VUB( 2 )=1 . 0E+20 

IDENTIFY  CONSTRAINTS  AS  NONLINEAR,  INEQUALITY. 

IDG( 1 )=0 
IDG(2)=0 
INPUT. 

READ ( 5 ,70)  ISTRAT , IOPT , IONED , I PRINT 
INITIALIZE  INTERNAL  PARAMETERS. 

INF0=-2 

CALL  ADS  (INFO, ISTRAT, IOPT, IONED, IPRINT , IGRAD , NDV , NCON , X , VLB, 

1  VUB , OBJ , G , IDG , NGT , IC , DF , A , NRA , NCOLA , VK, NRVK, IVK , NRIVK) 
OVER-RIDE  DEFAULT  VALUES  OF  CT,  CTMIN,  THETAZ  AND  ITRMOP. 
VK(3)=-0.05 
VK(6)=0.001 
VK(21)=0.001 
IWK(4)=2 
OPTIMIZE. 

CALL  ADS  (INFO, ISTRAT, IOPT, IONED, IPRINT, IGRAD, NDV, NCON, X, VLB, 

1  VUB, OBJ, G, IDG, NGT, IC,DF, A, NRA, NCOLA, VK,NRVK,IVK, NRIVK) 

IF  (INFO. EQ.O)  GO  TO  60 
IF  (INFO.GT.l)  GO  TO  20 
C  EVALUATE  OBJECTIVE  AND  CONSTRAINTS. 

0BJ=2. *SQRT(2. )*X(1)+X(2) 

G( 1 ) =( 2 . *X( 1 )+SQRT( 2 .)*X(2))/(2.*X(1)*(X(1 ) +SQRT (2. )*X(2)))-1. 
G(2)=.5/(X(1)+SQRT(2. )*X(2))-1. 

C  GO  CONTINUE  WITH  OPTIMIZATION. 

GO  TO  10 
20  CONTINUE 


Figure  10:  Example  3  -  Gradients  Supplied  by  the  User 
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C  GRADIENT  OF  OBJ. 

DF( 1 )  =  2 . *SQRT ( 2  .  ) 

DF(2)=1 .0 

IF  (NGT.EQ.O)  GO  TO  10 

C  CONSTRAINT  GRADIENTS.  USE  ARRAY  B  FOR  TEMPORARY  STORAGE. 

D1 = ( X( 1 ) +SQRT ( 2 . ) *X( 2 ) ) **2 
L  u  v  i  )  ■ 

3(1 , 1)  =  -(2.*X(1)*X(1)+2.*SQRT(2.  )*X(1)*X(2)*2.*X(?.)*X(2) )/ 

1  ( 2 . *X( 1 )*X( 1  )*D1 ) 

B(2,l)=-l./( SQRT ( 2 . )  *D1 ) 

C  G(2). 

B( 1 , 2 ) =-0 . 5/DI 

B( 2 , 2 ) =SQRT ( 2 . )*B(1,2) 

C  STORE  APPROPRIATE  GRADIENTS  IN  ARRAY  A. 

DO  30  J=1 , NGT 

K=IC(J) 

A(1,J)=B(1,K) 

.10  A(2,J)=B(2,K) 

GO  TO  10 
60  CONTINUE 

C  PRINT  RESULTS. 

WRITE(6 , 80)  OBJ,X(l),X(2),G(l),G(2) 

STOP 

70  FORMAT  (415) 

80  FORMAT  ( //5X , 7H0PTIMUM , 5X, 5H0BJ  =, E12 . 5//5X, 6HX( 1 )  =,E12.5,5X, 
1  6HX( 2 )  = , E12 . 5/5X , 6HG( 1 )  = , E12 . 5 , 5X , 6HG( 2 )  =,E12.5) 

END 


Figure  10  Concluded:  Example  3  -  Gradients  Supplied  bv  rhe  I'seL 
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FORTRAN  PROGRAM 
FOR 

AUTOMATED  DESIGN  SYNTHESIS 

(C)  COPYRIGHT,  EDO,  INC.,  1987 
ALL  RIGHTS  RESERVED,  WORLDWIDE 

VERSION  3.00 

CONTROL  PARAMETERS 

ISTRAT  =  0  IOPT  =  5  IONED  =  7  IPRINT  =  2020 

IGRAD  =  1  NDV  =  2  NCON  =  2 


SCALAR  PROGRAM  PARAMETERS 
REAL  PARAMETERS 


1) 

ALAMDZ 

= 

. OOOOOE+OO 

20) 

EXTRAP 

= 

5. OOOOOE+OO 

2) 

BETAMC 

= 

. OOOOOE+OO 

21) 

FDCH 

= 

1 . 00000E-03 

3) 

CT 

= 

-5 . OOOOOE-02 

22) 

FDCHM 

= 

1 . 00000E-03 

4) 

CTL 

= 

-5 . 00000E-03 

23) 

GMULTZ 

= 

1 . 00000E+01 

5) 

CTLMIN 

= 

1 . 00000E-03 

24) 

PSAIZ 

= 

9 . 50000E-01 

6) 

CTMIN 

= 

1 . 00000E-03 

25) 

RMULT 

= 

5. OOOOOE+OO 

7) 

DABALP 

= 

1 . 00000E-04 

26) 

RMVLMZ 

= 

2 . 00000E-01 

8) 

DABOBJ 

= 

3 . 82843E-03 

27) 

RP 

= 

1 . 00000E+01 

9) 

DABOBM 

= 

7 . 65685E-03 

28) 

RPMAX 

= 

1 . OOOOOE+IO 

10) 

DABSTR 

= 

3 . 82843E-03 

29) 

RPMULT 

= 

2 . 00000E-01 

11) 

DELALP 

= 

5 . 00000E-03 

30) 

RPPMIN 

= 

1 . 00000E-10 

12) 

DELOBJ 

= 

1 . 00000E-03 

31) 

RPPRIM 

= 

1 . 00000E+02 

13) 

DELOBM 

= 

1. 00000E-02 

32) 

SCFO 

= 

1. OOOOOE+OO 

14) 

DELSTR 

= 

1 . 00000E-03 

33) 

SCLMIN 

= 

1 . 00000E-03 

15) 

DL0BJ1 

= 

1 . 00000E-01 

34) 

STOL 

= 

1 . 00000E-03 

16) 

DL0BJ2 

= 

1 . 00000E+03 

35) 

THETAZ 

= 

1 . 00000E-01 

17) 

DX1 

= 

1. 00000E-02 

36) 

XMULT 

= 

2 . 61803E+00 

18) 

DX2 

= 

2 . 00000E-01 

37) 

ZRO 

= 

1 . 00000E-05 

19) 

EPSPEN 

= 

-5. 00000E-02 

38) 

PMLT 

= 

1 . 00000E+01 

INTEGER  PARAMETERS 

1)  ICNDIR  =  3 

4)  ITRMOP  =  2 

6)  JONED  = 

7 

2)  ISCAL  =  1 

5)  ITRMST  =  2 

7)  JTMAX  = 

20 

3)  ITMAX  =  40 

Figure  11:  Example  3 

-  Output 
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ARRAY  STORAGE  REQUIREMENTS 
DIMENSIONED  REQUIRED 
ARRAY  SIZE  SIZE 

VK  1000  199 

:  «"r’  500  18-i 


IOPT  =  5;  MODIFIED  METHOD  OF  FEASIBLE  DIRECTIONS 


--  INITIAL  DESIGN 

OBJ  =  3 . 82843E+00 

DECISION  VARIABLES  (X-VECTOR) 

1)  1 . OOOOOE+OO  1 . OOOOOE+OO 

LOWER  BOUNDS  ON  THE  DECISION  VARIABLES  (VLB-VECTOR) 
1)  1 . 00000E-02  1 . 00000E-02 

UPPER  BOUNDS  ON  THE  DECISION  VARIABLES  (VUB-VECTOR) 
1)  1 . 00000E+20  1 . 00000E+20 

CONSTRAINT  VALUES  (G-VECTOR) 

1)  -2 . 92893E-01  -7.92893E-01 


--  ITERATION  1  OBJ  =  2.79647E+00 

DECISION  VARIABLES  (X-VECTOR) 

1)  6 . 75687E-01  8.85338E-01 

--  ITERATION  2  OBJ  =  2.63882E+00 

DECISION  VARIABLES  (X-VECTOR) 

1)  7 . 98080E-01  3 . 81510E-01 


--  ITERATION  3  OBJ  =  2.63724E+00 

DECISION  VARIABLES  (X-VECTOR) 

1)  7 . 86367E-01  4.13059E-01 

Figure  11  Continued:  Example  3  -  Output 
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FINAL  OPTIMIZATION  RESULTS 


NUMBER  OF  ITERATIONS  =  4 

OBJECTIVE  =  2 . 63724E+00 

DECISION  VARIABLES  (X-VECTOR) 

1)  7 . 86367E-01  4.13059E-01 

CONSTRAINT  VALUES  (G-VECTOR) 

1)  6 . 60856E-04  -6.35175E-01 

CONSTRAINT  TOLERANCE,  CT  =  -2 . 50000E-02  CTL  =  -2.50000E-03 

THERE  ARE  1  ACTIVE  CONSTRAINTS  AND  0  VIOLATED  CONSTRAINTS 
CONSTRAINT  NUMBERS 
1 

THERE  ARE  0  ACTIVE  SIDE  CONSTRAINTS 
TERMINATION  CRITERIA 

KUHN-TUCKER  PARAMETER,  BETA  =  9.65595E-06  IS  LESS  THAN  1.00000E-03 

OPTIMIZATION  RESULTS 


OBJECTIVE  FUNCTION  VALUE  2.63724E+00 


DESIGN  VARIABLES 


LOWER 

VARIABLE  BOUND 

1  1 . 00000E-02 

2  1 . OOOOOE-Q2 


VALUE 

7 . 86367E-01 
4. 13059E-01 


UPPER 

BOUND 

1 . 00000E+20 
1 . 00000E+20 


DESIGN  CONSTRAINTS 


1)  6 . 6086E-04  -6.3517E-01 


FUNCTION  EVALUATIONS  =  21 
GRADIENT  EVALUATIONS  =  4 


OPTIMUM  OBJ  =  . 26372E+01 

X(l)  =  . 78637E+00  X(2)  =  .41306E+00 

G ( 1 )  =  . 66086E-03  G(2)  =  -.63517E+00 

Figure  11  Concluded:  Example  3  -  Output 
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6.0  MAIN  PROGRAM  FOR  SIMPLIFIED  USAGE  OF  ADS 


Figure  10  is  a  general- purpose  calling  program  for  use  with  ADS.  The 
arrays  are  dimensioned  sufficient;  to  solve  problems  of  up  to  20  design  variables 
and  100  constraints.  Arrays  IC  and  A  are  dimensioned  to  allov  for  evaluation  of 
2.  .  g.aiio::-.  .  ’-’her  ever  a  question  mark  (?)  is  given.  it  is 

undo:  st  i  '.nat  the  user  '-'ill  supply  the  appropriate  information.  Note  that  the 
s  ta  r  e t  1  =  3,  NDV  is  not  an  implied  FORTRAN  DO  LOOP,  but  simply  denotes 

'but  v  a v.e  of  the  NDV  design  variables  must  be  defined  here . 

S.'.i'r  1 1  r.e  EVAL  is  the  user-supplied  subroutine  for  evaluating  functions 

and  ;; :  v:i :  •  :t 1  (i:  user  supr  L  i  ed  )  .  The  calling  statement  is: 

CA  L  L  E  V2  L  ( I N  EG  .  NDV .  .‘ICON  ,0BJ,X,G,DF.  NGT ,  IC ,  A ,  NR  A  ) 

The  parameters  INFO,  NDV,  NC0N,  X,  NGT,  IC  and  NRA  are  input  to  Subroutine  EVAL, 
vhile  03 J.  G.  DF  and  A  are  output.  Depending  on  the  user  needs,  this  may  be 
simplified.  For  example,  if  IGRAD=0  and  NDV  and  NC0N  are  not  required  by  the 
analysis,  the  calling  statement  may  be 

CALL  EVAL  (CBJ,X,G) 

Also,  a  print  control  may  be  added  so,  after  the  optimization  is  complete,  EVAL 
can  be  called  again  to  print  analysis  information. 

C  SIMPLIFIED  USAGE  OF  THE  ADS  OPTIMIZATION  PROGRAM. 

DIMENSION  X( 21 ) , VLB( 21 ) , VUB(21 ) , G( 100) , IDG( 100) , IC( 30) , DF( 21 ) , 

*  A( 21. 30 ) ,VK( 10000) ,IVK( 2000) 

NRA=21 
NC0LA=30 
NRVK= 10000 
NR INK =2000 

C  INITIALIZATION. 

t  q  c  r  i  _  n 
NDV  =  ? 

NC0N  =  ? 

X(I)=7,  1=1, NDV 
VLB ( I )  =  ? ,  1  =  1, NDV 

VU3 ( I ) =? ,  1=1, NDV 

I DG ( I )  =  ?  1  =  1, NC0N 

I STRAT=? 

I0PT=? 

IQNED=? 

I  PRINT  = ? 

INF0=0 

10  CALL  ADS  ( INFO , ISTRAT , IOPT , I0NED, I PRINT , IGRAD, NDV , NCON , X , 

”  V  L3 . V UB , OR  J , G , I DG . NGT , I C , DF , A , NRA , NCOLA , VK , NR VK , I VK  ,  NR I UK ) 

CALL  EVAL  ( INFO , NDV , NCON , OBJ , X , G , DF , NGT , IC , A , NRA ) 

IF  ( JNF0.G7.0)  GO  TO  10 

C  OPTIMIZATION  IS  COMPLETE.  PRINT  RESULTS. 

T'.1 : 
r.N 


Simplified  Usage  of  ADS 
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mm 


;  TO  ADS  OPTIONS 


OPTIMIZER 

Fie tcher-Reeves 
Davidon-Fletcher-Powell  (DFP) 
Broydon-Fletcher-Goldfarb-Shanno  (BFGS) 
Method  of  Feasible  Directions 
Modified  Method  of  Feasible  Directions 


STRATEGY 


ISTRAT  IOPT  1 


None  0 
SUMT,  Exterior  1 
SUMT,  Linear  Extended  Interior  2 
SUMT,  Quadratic  Extended  Interior  3 
SUMT,  Cubic  Extended  Interior  4 
Augmented  Lagrange  Multiplier  Meth.  5 
Sequential  Linear  Programming  6 
Method  of  Centers  7 
Sequential  Quadratic  Programming  8 
Sequential  Convex  Programming  9 


ONE-DIMENSIONAL  SEARCH 


IONED 


Golden  Section  Method 
Golden  Section  +  Polynomial 
Polynomial  Interpolation  (bounded) 
Polynomial  Extrapolation 
Golden  Section  Method 
Golden  Section  +  Polynomial 
Polynomial  Interpolation  (bounded) 
Polynomial  Extrapolation 


NOTE:  An  X  denotes  an  allowed  combination  of  algorithms. 
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append; x  b 

INFORMATION  STORED  IN  ARRAYS  VK  AND  IVK 


■a  UK  and  IVK  contain  information  calculated  by  ADS  vhich  is  sometimes 
"on: tori ng  the  progress  of  the  optimization.  Tables  3  I  and  B-2 
parameters  -hich  may  be  of  interest  to  the  user.  Note  that  these 
;  must  nor  he  changed  by  the  user  during  the  optimization  process . 


TABLE  3-1:  REAL  PARAMETERS  STORED  IN  ARRAY  VK 
PARAMETER  LOCATION  DEFINITION 


52  Move  parameter  in  the  one-dimensional  search. 

53  Alpha  at  the  strategy  level  for  ISTRAT=3. 

82  The  value  of  the  penalty  in  SUMT  methods. 

85  The  slope  of  the  03.J  versus  M.PHA  function  in  the 

one -dimensional  search. 
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TABLE  B-2 :  INTEGER  PARAMETERS  STORED  IN  ARRAY  IVK 


PAPAMETER 

LOCATION 

DEFINITION 

IDAB 

23 

Number  of  consecutive  times  the  absolute 
convergence  criterion  has  been  satisfied  at  the 
optimization  level. 

IDAB3 

24 

Same  as  IDAB,  but  at  the  strategy  level. 

IDEL 

25 

Number  of  consecutive  times  the  relative 
convergence  criterion  has  been  satisfied  at  the 
optimization  level. 

IDEL3 

26 

Same  as  IDEL,  but  at  the  strategy  level. 

IFCALL 

28 

The  number  of  times  the  objective  and  constraint 
functions  have  been  evaluated. 

IGCALL 

29 

The  number  of  times  analytic  gradients  have  been 
evaluated . 

I  HAT 

34 

Pointer  telling  the  status  of  the  optimization 
process . 

0  -  Optimization  is  complete. 

1  -  Initialization  is  complete  and  control  is  being 

returned  to  the  user  to  over-ride  default 
parameters . 

2  -  Initial  function  evaluation. 

3  -  Calculating  analytic  gradients. 

4  -  Calculating  finite  difference  gradients.  NXFD 

identifies  the  design  variable  being  changed. 


5  -  One-dimensional 
See  LGOTO. 

search  is  being  performed 

ITER 

45 

Iteration  number  at 

the  optimization  level. 

JTER 

46 

Iteration  number  at 

the  strategy  level. 

LGOTO 

54 

Location  in  one-dimensional  search. 

1  -  Finding  bounds  on  the  solution. 

2  -  Golden  Section  method. 

3  -  Polynomial  interpolation  after  Golden  Section. 

4  -  Polynomial  interpolation  after  getting  bounds. 

5  -  Polynomial  interpolation/extrapolation. 


NAC 

58 

Number 

of 

active  constraints. 

NACS 

59 

Number 

of 

active  side  constraints. 

NVC 

68 

Number 

of 

violated  constraints. 

NXFD 

69 

Design 

variable  being  perturbed  during  finite 

difference  gradients. 
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APPENDIX  C 


;•?.  specified  combination  cr  idtp.at,  iopt  and  toned 


;--.-::;i  in.g  0:1  the  c  air.hina  t  ion  o':  ISTRAT,  IOPT  and  IONED.  only  a  uubse  t  of 
contained  in  the  ADS  sys  tern  are  used.  Therefore,  if  com  pi;  to:  memory 
is  1  i  :  *.  erf ,  it  nay  be  desired  only  to  load  those  routines  which  are  actually 
usee.  This  vill  result  in  "unsatisfied  externals"  at  run  tine,  but  r-n  nost 
sys  tens  the  program  can  be  executed  anyway  since  the  unsatisfied  external 
routines  are  not  actually  called.  Below  is  a  list  of  the  routines  needed  for  a 
iven  combination  of  algorithms.  In  some  cases,  slightly  more  routines  are 
included  than  are  absolutely  necessary,  but  they  are  short  and  a  more  precise 
list  would  be  undully  complicated. 


ALWAYS  LOAD  THE  FOLLOWING  SUBROUTINES: 


ADS,  ADS001,  ADS002 ,  ADS004.  ADS005 ,  ADS006 ,  ADS007 ,  ADS009,  ADS010. 
ADS102.  ADS103 ,  ADS105,  ADS112,  ADSx22,  ADS201,  ADS206,  ADS211,  ADS216, 
ADS237.  ADS401,  ADS402,  ADS403,  ADS420,  ADS503,  ADS504,  ADS506, 

ADS510 


ADS236, 


STRATEGY  LEVEL 

Depending  on  the  value  of  ISTRAT,  the  following  subroutines  are  also 
requ : red  : 

ISTRAT  =  0.  No  strategy  routines  are  added.  Go  to  the  optimizer  level. 

I  ST?  AT  -=  1.  Add:  ADS^'CS,  ’.DS301,  ADS302 ,  ADS508 


ISTRAT  = 

7 

*-  * 

Add: 

ADS008 , 

ADS302 ,  ADS303 ,  ADS308, 

ADS508 

ISTRAT  - 

1 

U  t 

Add: 

ADS008, 

ADS302 ,  ADS304 ,  ADS308, 

ADS508 

ISTRAT  =: 

4, 

Add  : 

ADS008 , 

ADS302 ,  ADS305 ,  ADS308, 

ADS508 

ISTRAT  = 

5, 

Add: 

ADS008 , 

ADS302 ,  ADS306 ,  ADS307 , 

ADS508 

ISTRAT  =- 

6, 

Add : 

ADS320 , 

ADS321,  ADS323,  ADS333 

ISTRAT  = 

7 

Add : 

ADS323 , 

ADS330 ,  ADS331,  ADS333 

it::- a: 

6  ♦ 

Add : 

ADS207 , 

ADS217 ,  ADS218 ,  ADS221, 

ADS223, 

ADS310 , 

ADS333 , 

ADS371 , 

ADS375,  ADS376,  ADS377, 

ADS378, 

ADS404 , 

ADS507, 

ADS503 , 

ADS509 

. 

A  d  d  • 

ADS 20 7 , 

ADS217 ,  ADS 2 18 ,  ADS221, 

ADS223, 

ADS325 , 

ADS326 , 

ADS 50? 
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OPTIMIZER  LEVEL 


Depending 
requ i red : 

or.  the 

value 

of  IOPT,  the 

following  subroutines 

IOPT  =  1, 

Add: 

ADS204 , 

ADS213 , 

ADS214 , 

ADS509 

IOPT  =  2, 

Add  : 

ADS 2 1 3 , 

ADS214 , 

ADS235 , 

ADS404 , 

ADS503 , 

ADS509 

IOPT  =  3, 

Add: 

ADS213 , 

ADS214 , 

ADS235 , 

ADS404 , 

ADS503 , 

ADS509 

IOPT  =  4, 

Add: 

ADS201 , 
ADS507 

ADS205 , 

ADS207 , 

ADS217 , 

ADS218 , 

ADS221, 

ADS223 , 

IOPT  =  5, 

Add: 

ADS201 , 

ADS202 , 

ADS203 , 

ADS207 , 

ADS209 , 

ADS217, 

ADS218, 

ADS221,  ADS223 ,  ADS235,  ADS507 


ONE-DIMENSIONAL  SEARCH  LEVEL 

Depending  on  the  value  of  IONED,  the  following  subroutines  are  also 
required : 

IONED  =  1-4,  Add:  ADS116,  ADS117,  ADS118,  ADS121,  ADS126,  ADS127 

IONED  =  5-8,  Add:  ADS101,  ADS104,  ADS106,  ADS108,  ADS109,  ADS110, 

ADS111,  ADS115 ,  ADS119 ,  ADS129,  ADS124,  ADS125, 

ADS502 
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APPENDIX  D 


ADS  SYSTEM  SUBROUTINES 

s’ibrou  t  i  nes  in  the  ADS  system  are  listed  heve  v  i  *  h  a  -e: 

descr :  r;  •  ion  of  each.  “os  t  subroutines  are  internally  dccumen  •  ed ,  and 

is  referred  to  the  pr>'gram  listing  for  more  details. 

.illy  .  ADSr;  ?I  ■  ACSO/9  are  control  level  routines  .  ADS  1  hi  -  AD: 
o  :  i  s  icr.a  l  search,  level  routines,  ADS20  1  -ADS???  are  o  r  t  i  ~  i  r  a  •  : ' 

:v  and  ADS:  )1-ADS:9 9  are  strategy  level  routines.  ADSA'J  1  -  ADS**  ’■  1*  a 

r  ?■:  t  i  r.i:.’  and  A  r  5  3  0 1  -  A  D  S  b  9  9  are  utility  routines. 


ROUTINE 

ADS 

ADS001 

ADS002 

ADS003 

ADS004 

ADS0C5 

ADS0C6 

ADS007 

ADSOOS 

ADS'..  .  4 

A  DSC  1 

ADS  101 

ADSIOC 

ADS  10  ; 

ADS  10- 

ADS  10: 

*  M  f*  1  ■" ,  , 


PURPOSE 

-  Main  control  routine  for  optimization. 

-  Control  one-dimensional  search  level. 

-  Control  optimizer  level. 

-  Control  strategy  level. 

-  Define  vork  array  storage  allocations. 

-  Initialize  scalar  parameters  to  their  default  values. 

-  Initialize  scale  factors. 

-  Calculate  scale  factors,  scale,  unscale. 

-  Calculate  gradients  of  pseudo-objective  for  ISTRAT=l-5. 

-  Re-order  1C  and  A  arrays. 

-  Calculates  convergence  criteria  parameters. 

-  Coefficients  of  linear  polynomial. 

-  Coefficients  of  quadratic  polynomial. 

-  Coefficients  of  cubic  polynomial. 

-  Zeroes  of  polynomial  to  third-order. 

-  Minimums  of  polynomial  to  third-order. 

-  Evaluate  n-th  order  polynomial. 

-  rind  minimum  of  a  function  by  polynomial  interpolai  on. 
F :  ::d  zeroes  of  a  function  by  polynomial  interpolation. 


ROUTINE 


PURPOSE 


ADS110 

ADS111 

ADS112 

ADS115 

ADS116 

ADS117 

ADS118 

ADS119 

ADS121 

ADS122 

ADS123 

ADS124 

ADS125 

ADS126 

ADS127 

ADS201 

ADS202 

ADS203 

ADS204 

ADS205 

ADS206 

ADS207 


-  Evaluate  slope  of  n-th  order  polynomial. 

-  Polynomial  interpolation  for  constraint  boundaries. 

-  Find  ALPMAX  so  NDV  side  constraints  are  encountered. 

-  Control  one-dimensional  search  for  constrained  functions. 

-  Control  one-dimensional  search  for  unconstrained  functions. 

-  Polynomial  interpolation  of  unconstrained  function,  within 
bounds . 

-  Polynomial  interpolation  of  unconstrained  function,  no 
bounds  given. 

-  Polynomial  interpolation  of  constrained  function,  no  bounds 
given. 

-  Find  bounds  on  minimum  of  unconstrained  function. 

-  Initial  interior  points  for  Golden  Section  method. 

-  Constrained  one-dimensional  search  by  Golden  Section  method. 

-  Update  bounds  and  get  new  interior  point  in  Golden  Section 
method,  constrained. 

-  Find  bounds  on  minimum  of  constrained  function. 

-  Unconstrained  one-d '.mensional  search  by  Golden  Section 
method . 

-  Update  bounds  and  get  new  interior  point  by  Golden  Section 
method,  unconstrained. 

-  Identify  NGT  most  critical  constraints. 

-  Invert  matrix  B  and  store  back  in  B. 

-  Delta-X  back  to  boundary  in  Modified  Method  of  Feasible 
Di rect ions . 

-  Fletcher-Reeves  unconstrained  minimization. 

-  Method  of  Feasible  Directions. 

-  X  =  Xold  +  ALPHA*S,  subject  to  side  constraints. 

-  Maximum  component  (magnitude)  of  each  column  of  A. 


42 


PURPOSE 


ROUTINE 

ADST?'- 

ads:  : : 
ads:  : : 

ads::- 


ads::p 

A  D  S  2  2 1 

ADS223 

ADS231 

ADS235 

ADS236 

ADS23? 

ADS301 

ADS  302 

ADS303 

ADS  304 

ADS305 

ADS  306 

ADS3Q7 

ADS308 

ADS310 

ADS  3 20 

ADS321 


-  Calculate  B  =  A-Transpose  times  A. 

-  Update  convergence  parameters  IDEL  and  IDAB. 

-  Calculate  initial  ALPHA  for  one-dimensional  search  based  on 
objective  function  value. 

-  Calculate  initial  ALPHA  for  one-diirens  ional  search  based  or. 
X- values  ■ 

-  Finite  difference  gradients  of  objective  and  constraints- 

Solve  ai rec t  ion- finding  task  for  Methods  of  Feasible 
Di rec : icns  . 

-  Solve  special  LP  sub-problem  from  ADS217. 

-  Push-off  factors  for  Methods  of  Feasible  Directions. 

-  Identify  active  side  constraints. 

-  Modified  Method  of  Feasible  Directions. 

-  Variable  Metric  Methods,  IOPT=2,3. 

-  Search  direction  for  Variable  Metric  Methods. 

-  Penalty  for  equality  constraints,  I0PT=4,5. 

-  Exterior  Penalty  Function  Method,  ISTRAT=1. 

-  Calculates  penalty  for  penalty  function  methods,  ISTRAT=l-5. 

-  Linear  Extended  Penalty  Function  Method,  ISTRAT=2. 

-  Quadratic  Extended  Penalty  Function  Method,  ISTRAT=3. 

-  Cubic  Extended  Penalty  Function  Method,  ISTRAT=4. 

-  Augmented  Lagrange  Multiplier  Method,  ISTRAT=5. 

-  Update  Lagrange  Multipliers,  ISTRAT=5. 

-  Calculate  penalty  parameters,  ISTRAT=5. 

-  Sequential  Quadratic  Programming,  ISTRAT=8. 

-  Sequential  Linear  Programming,  ISTRAT=6. 

-  Control  solution  of  LP  sub-problem,  ISTRAT=6. 
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ROUTINE 


PURPOSE 


ADS323 

ADS325 

ADS326 

ADS330 

ADS331 

ADS333 

ADS371 

ADS375 

ADS376 

ADS377 

ADS378 

ADS401 

ADSA02 

ADS403 

ADS404 

ADS420 

ADS501 

ADS502 

ADS503 

ADS504 

ADS506 

ADS507 

ADS508 

ADS509 

ADS510 


Update  move  limits,  ISTRAT=6,7. 

Sequential  Convex  Programming,  ISTRAT=9. 

Solve  convex  sub-problem,  ISTRAT=9. 

Method  of  Centers,  ISTRAT=7. 

Control  solution  of  LP  sub-problem,  ISTRAT=7. 

Calculate  maximum  constraint  value. 

Control  solution  of  QP  sub-problem,  ISTRAT=8. 

Temporary  objective,  ISTRAT=8. 

Gradient  of  pseudo-objective  for  one-dimensional  search, 
ISTRAT=8. 

Change  in  objective  gradients,  ISTRAT=8. 

Update  Hessian  matrix,  ISTRAT=8. 

Print  arrays. 

Print  array  title  and  array.  Calls  ADS401. 

Print  scalar  control  parameters. 

Print  Hessian  matrix. 

Print  final  optimization  results. 

Evaluate  scalar  product  of  tvo  vectors. 

Find  maximum  component  of  vector. 

Equate  two  vectors. 

Matrix-vector  product. 

Initialize  symmetric  matrix  to  the  identity  matrix. 

Normalize  vector  by  dividing  by  maximum  component. 

Calculate  gradient  of  pseudo-objective  for  ISTRAT=l-5. 
Called  by  ADS008. 

Identify  active  side  constraints. 

Scale,  unscale  the  X-vector. 
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APPENDIX  E 


IN  CASE  OF  DIFFICULTY 

T.'.-j  ADS  program  : relatively  rebuilt,  and  there  should  seldom  be  a  case 
-here  n  pr  gross  is  cade  during  the  optimization.  Also,  numerous  internal 
check.-:  made  to  avoid  exponent  overflows,  divide  by  zero,  and  similar  run 

Usually,  when  something  seems  wrong,  it  can  be  traced  to  the  basic  setup  of 
the  optimization  problem  or  (more  often)  simple  programming  errors.  Thus,  while 
it  is  difficult  to  project  all  possible  errors,  some  are  common  enough  to  be 
able  to  offer  the  following  short  list  of  items  to  check. 

Check  all  array  dimension  statements.  Be  sure  the  values  of  NRA ,  NCOLA, 
NR VP  and  NRIwK  are  correct.  ADS  is  written  in  single  precision  and  double 
precision  should  really  not  be  needed  at  the  optimization  level.  If  the 

analysis  program  is  written  in  double  precision,  be  sure  to  transfer  all 

variables  and  arrays  to  equivilant  single  dimension  values  before  calling  ADS 
and  transfer  them  back  on  return.  This  effects  very  few  parameters  and 

arrays,  but  is  sometimes  overlooked,  and  is  very  difficult  to  debug. 

2.  Check  the  parameter  list  for  calling  ADS.  Be  sure  all  parameters  are 

present  and  in  the  proper  order.  A  common  error  is  to  create  a  program  with 
an  act  tor  that  allows  SO  column  lines,  while  using  a  compiler  that  ignores  all 
c  h  <?.  i’  i  r  t  \  s  n  t  *i  c  r  column  72. 

3.  Turn  off  the  automatic  scaling  and  try  again.  Use  the  over-ride  capability 
and  set  IVK(2)  =  0.  Sometimes  the  scaling  actually  makes  the  conditioning  of 
the  problem  worse,  although  in  Version  2.00  it  is  greatly  improved  from 
before.  If  the  difficulties  still  exist,  leave  the  scaling  turned  off  during 
further  testing. 

4.  Set  the  print  control,  IPRINT  to  3500  if  ISTRAT  is  greater  than  zero  or  3050 
if  ISTRAT  is  equal  zero.  This  will  cause  gradient  information  to  be  printed 
during  the  optimization.  If  the  gradient  of  the  objective  or  any  constraint 
function  has  all  zeroes,  this  parameter  is  not  a  function  of  the  design 
variables.  Chile  it  is  theoretically  possible  to  have  a  zero  gradient,  it  is 
extremely  rare  on  a  digital  computer.  Check  problem  formulation. 

5.  Check  the  order  of  magnitude  of  the  components  of  the  gradients.  A  well 

conn : t : oned  problem  will  have  roughly  the  same  order  of  magnitude  values 
(w: 'km  a  factor  of  100).  If  one  term  is  several  orders  of  magnitude  greater 
than  the  others  it  may  help  to  scale  this  design  variable  by  dividing  by  a 
nrv-:  '■■■  that  order  of  magnitude.  A  common  error  in  problem  formulation  is 
t  •’  s  •/•••  a  function,  say  Q  that  must  be  less  than  QQ ,  where  QQ  is  on  the  order 

or  .  b.  In  creating  the  constr iant  (which  is  required  to  be  less  than  or 

-  ‘  cer-  j  we  may  write  G(I)  =  Q  -  QQ.  This  will  make  the  constraint  very 
d :  :  :  :  .  t  to  deal  with  by  ADS,  because  Q  must  equal  about  9,999.95  before  the 
con  •  :  :  an  t  : considered  active.  Therefore,  it  is  important  to  s^alc  the 
constraint  as  G(I)  =  Q/QQ  -  1.  Now  a  constraint  value  of  -0.01  will  identify 
the  constraint  as  being  within  one  percent  of  being  critical. 


45 


6.  As  a  last  resort,  turn  on  the  one-dimensional  search  print  control  (set  the 
last  digit  of  IPRINT  to  5).  Plot  the  objective  and  constraint  functions 
versus  the  move  parameter,  ALPHA.  If  one  or  more  are  extremely  nonlinear, 
reformulation  of  the  problem  by  dividing  that  function  by  a  large  number  is 
indicated.  Another  possibility  here  is  that  the  finite  difference  gradient 
parameters,  FDCH  and  FDCHM  are  either  too  large  or  too  small.  If  the  analysis 
is  iterative,  it  often  helps  to  try  FDCH  =  0.02  or  larger  and  FDCHM  =  0.01  or 
larger.  This  will  mask  the  inacuracies  in  the  analysis.  On  ther  other  hand, 
if  the  analysis  is  calculated  very  precisely  as  functions  of  the  design 
varibles,  an  order  of  magnitude  smaller  than  the  default  value  is  indicated. 

7.  If  the  last  resort  fails,  call  EDO.  Ve  will  do  our  best  to  help. 
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APPENDIX  F 


ADS  INTERNAL  PARAMETER  DESCRIPTION 

I  append  ix  \  description  of  the  ADS  internal  parameters  i  s  given. 

:r  r.c- rcssa r  L  iy  brief,  it  is  somewhat  more  detailed  than  th-_-  ziiptic 
:  r. :  :  -  i  •  i  - ::  o  u’amori  in  '  i  •  •  n  4.3. 

a are  listed  in  alphabetical  order .  I  f  it  is  uniiKeiv  that 
•  n  •..•  .1:  t :  should  be  changed  from  its  default  value,  this  is  stated. 
Referon  :e  -2  describes  most  of  the  algorithms  contained  in  ADS,  and  may  be 
referee  to  for  a  more  detailed  description  of  how  a  parameter  is  used  in  a  given 
algor  i  trim. 


REAL  PARAMETERS  CONTAINED  IN  WK 

ALAMDE  Used  for  ISTRAT  =  5.  Initial  values  for  the  Lagrange  Multipliers  for 
the  Augmented  Lagrange  Multiplier  method.  Applies  to  all  constraints. 
Usually  the  default  values  are  adequate. 

BETAMC  -  Used  only  with  ISTRAT  =  7.  This  provides  an  additional  steepest 
descent  move  in  the  method  of  centers  beyond  the  move  to  the  center  of  the 
hypersphere.  The  basic  method  moves  to  the  center  of  the  hyoersphere 
bounded  by  the  linear  approximation  to  the  current  objective  function  and 
cons  triants .  In  problems  that  are  not  too  highly  nonlinear,  this  may  be 
quite  conservative.  Using  BETAMC,  it  is  possible  to  move  an  additional 
amount  in  a  steepest  descent  direction  in  order  to  speed  convergence.  If 
the  move  is  too  far  (it  violates  constriants)  it  will  be  automatically 
reduced,  but  at  the  expense  of  a  function  evaluation.  The  general  concept 
:s  shown  in  the  figure  below,  where  the  intial  move  is  to  the  center  of 
the  circle  (a  hypersphere  in  two-dimensional  space  is  a  circle).  The 
additional  move  is  in  the  direction  negative  to  the  gradient  of  the 
objective  function.  BETAMC  =  1.0  will  move  to  the  edge  of  the  circle.  A 
larger  value  is  usually  too  optimistic,  while  a  value  of  0.5  will  often  be 
about  right. 
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CT  - 


CTMIN 


Used  with  IOPT  =  4  or  5.  Also  used  with  ISTRAT  =  1-9  to  a  slightly 
lessor  degree.  Constraint  tolorance  for  nonlinear  inequality  constriants. 
This  parameter  defines  when  a  constraint  is  considered  active,  and  is 
perhaps  the  most  important  parameter  for  nonlinear  constrained 
optimization. 

One  of  the  key  issues  in  constrained  optimization  is  determining  when  a 
constraint  is  numerically  "critical."  If  a  constriant,  G  ( I )  is 
numerically  greater  than  CT,  it  is  considered  critical  for  purposes  of 
finding  a  new  search  direction  or  deciding  if  the  optimum  has  been  found. 
This  is  also  why  constraint  should  be  normalized  to  order  of  magnitude  of 
unity.  Thus  if  G ( I )  is  numerically  greater  than  CT  (say  -0.03)  then  it  is 
assumed  to  be  within  3  percent  of  being  critical.  Numerically,  this  is 
considered  to  be  an  "active"  constriant. 

For  highly  nonlinear  constraints,  it  is  often  helpful  to  make  CT  more 
negative,  say  -0.10.  By  this  method,  the  constraint  is  "trapped"  sooner 
and  the  optimization  process  will  direct  the  design  away  from  this 
constraint.  On  the  other  hand,  if  the  constriant  is  nearly  linear,  it  may 
help  to  make  CT  closer  to  zero,  say  -0.01.  Then,  when  interpolating  for 
G(I)  =  0,  a  more  precise  value  of  G(I)  is  obtained.  In  either  case,  the 
value  of  CT  is  progressively  reduced  during  optimization  to  a  value  of 
-CTMIN,  which  is  the  value  at  which  a  constraint  becomes  strongly 
critical.  In  fact,  if  G(I)  exceeds  CTMIN  (a  positive)  number,  the 
constriant  is  considered  to  be  violated.  See  the  definition  of  CTMIN. 

For  IOPT  =  4  and  5,  if  a  constriant  repeatedly  becomes  active  on  one 
iteration  and  inactive  on  the  next,  CT  should  be  increased  in  magnitude 
(say  try  CT  =  -0.1  or  -0.15),  or  the  offending  constraint  should  be 
divided  by  a  factor  of  ten  to  reduce  its  sensitivity. 

Note  that  in  ADS,  equality  constraints  are  converted  to  equivilant 
inequality  constriants.  Therefore,  the  definitions  of  CT,  CTMIN,  CTL  and 
CTLMIN  apply  to  equality  constraints  as  well. 

-  Used  with  IOPT  =  4  or  5.  Also  used  with  ISTRAT  =  1-9  to  a  slightly 
lessor  degree.  Constraint  tolorance  defining  when  nonlinear  inequality 
constriants  are  violated.  CTMIN  is  a  positive  number.  A  constraint  is 
considered  inactive  if  its  value  is  more  negative  than  CT  and  active  if 
its  value  is  between  CT  and  CTMIN.  If  the  constraint  value  is  more 
positive  than  CTMIN,  it  is  considered  violated.  This  is  perhaps  the 
second  most  important  parameter  for  nonlinear  constrained  optimization. 

Since,  mathematically,  an  inequality  constriant  if  violated  any  time  its 
value  is  greater  than  zero,  there  may  be  a  temptation  to  set  CTMIN  =  0. 
However,  this  should  not  be  done  because  the  optimization  algorithms 
interpolate  on  zero  and  some  numerical  bandwidth  should  be  provided  to 
allow  for  numerical  inaccuracies.  The  default  value  allows  for  about  a 
half  of  a  percent  constriant  violation  for  normalized  constraints. 

The  geometric  relationship  between  a  constraint,  G,  and  the  parameters  CT 
and  CTMIN  is  shown  in  the  following  figure. 
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CTL,  CTI.MIN  -  These  parameters  have  the  same  definition  as  CT  and  CTMIN,  but  for 
strictly  linear  constraints.  Because  numerical  interpolation  is  more 
precise  for  linear  cons t raints ,  these  values  are  smaller  in  magnitude  than 
CT  and  CTMIN.  CTL  is  reduced  during  the  optimization  process  to  a 
magnitude  approaching  CTLMIN,  but  opposite  in  sign. 

Caution:  Do  not  define  a  constraint  as  linear  unless  you  are  absolutely 

sure  it  is.  If  a  linear  constraint  is  treated  as  nonlinear,  efficiency  is 
only  slightly  reduced,  but  if  a  nonlinear  constraint  is  treated  as  linear, 
the  result  may  be  non-convergence. 

DABALP  -  Used  in  IONED  =  1  and  5.  Convergence  criteria  in  the  Golden  Section 
method  for  the  one-dimensional  search.  If  IONED  =  2  or  6,  a  larger  value 

is  used  (by  a  factor  of  100),  since  the  Golden  Section  search  vill  be 

followed  by  a  cubic  polynomial  interpolation  using  the  final  four  points. 

If  it  is  desired  to  find  a  very  precise  solution  to  the  one-dimensional 
search,  DABALP  can  be  reduced.  Alternatively,  a  larger  value  vill  give  a 
less  precise  answer.  It  is  normally  not  desired  to  change  DABALP.  The 

default  value  gives  high  precision  on  the  assumption  that  function  values 

are  cheap,  or  else  the  Golden  Section  method  would  not  be  used. 

DABOBJ  -  Used  in  all  IOPT  options.  Absolute  convergence  criteria  for 

optimization.  If  the  objective  function  is  changed  by  less  than  this 
value  for  ITRMOP  iterations,  the  optimization  vill  terminate.  If  the 
objective  function  changes  by  more  than  one  order  of  magnitude  during 
optimization,  the  default  value  for  DABOBJ  vill  probably  cause  premature 
convergence.  In  this  case,  it  is  usually  desirable  to  set  DABOBJ  to  a 

small  number,  say  0.001,  and  let  the  optimization  process  converge  based 
on  the  relative  change  criteria  defined  by  DEL0BJ. 

DAB0BM  -  Used  with  all  strategies.  This  is  the  value  of  DABOBJ  used  during  the 
optimization  sub-problem  and  is  larger  than  DABOBJ.  The  reason  for  this 
relaxed  convergence  criteria  is  that  the  optimizer  vill  be  called 
repeatedly  by  the  strategy.  Therefore,  the  solution  of  the  sub-problem 
during  the  early  stages  is  not  as  critical  as  if  a  strategy  is  not  used. 
The  rules  for  changing  DABOBJ  apply  here  also. 
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DABSTR  -  Used  with  all  strategies.  This  is  the  overall  absolute  convergence 
criteria.  If  the  objective  function  is  changed  by  less  than  this  value  for 
ITRMST  iterations  by  the  strategy,  the  optimization  vill  terminate.  This 
has  the  same  general  meaning  as  DABOBJ  and  the  same  rules  apply. 

DELALP,  DELOBJ ,  DELOBM,  DELSTR  -  These  parameters  are  used  where  then 
counterparts  DABxxx  are  used  above.  However,  here  the  convergence  is 
tested  on  the  relative  change  in  the  objective  function.  The  combination 
DABxxx  and  DELxxx  work  together  to  form  the  diminishing  returns 
convergence  criteria  in  ADS.  Here  by  relative  change  we  mean  the 

fractional  change  in  the  value  of  the  objective  function  between 
successive  iterations. 

If  the  objective  function  is  quite  small  in  magnitude,  a  relative  change, 
of  say  one  percent,  may  not  be  meaningful  and  so  the  absolute  criteria  are 
relied  on  to  detect  convergence.  On  the  other  hand,  for  large  values  of 
the  objective  function,  the  absolute  change  is  considered  of  lessor 
importance  and  the  relative  criteria  tend  to  control  the  optimization 
convergence . 

DL0BJ1  -  Used  in  all  one-dimensional  searches.  On  the  first  search,  it  is 
difficult  to  estimate  a  desirable  move  parameter,  ALPHA,  because  the 
optimization  process  has  no  history.  DL0BJ1  is  used  to  estimate  the  ALPHA 
which  will  reduce  the  objective  function  by  this  ftaction,  based  on  a 
linear  approximation  to  the  problem.  Thus,  for  DL0BJ1  =  0.1,  the  first 
step  in  the  one-dimensional  search  will  attempt  to  reduce  the  objective  by 
ten  percent. 

If  the  problem  is  highly  nonlinear,  so  that  the  calculated  ALPHA  is 
consistantly  less  than  the  proposed  ALPHA,  efficiency  will  be  improved  by 
reducing  DL0BJ1.  Alternatively,  if  the  calculated  ALPHA  is  consistantly 
greater  than  the  proposed  ALPHA,  it  is  desirable  to  increase  DL0BJ1. 

DL0BJ2  -  Used  in  all  one-dimensional  searches.  If  the  objective  function  is 
quite  large  in  magnitude,  a  move  to  reduce  the  objective  by  the  fraction 
DL0BJ1  may  be  too  large.  In  this  case,  DL0BJ2  is  used  to  limit  the  change 
in  the  objective  function  to  the  magnitude  of  DL0BJ2.  In  other  words. 
Dl.OBJl  is  a  fractional  change  and  DL0BJ2  is  an  absolute  change.  As  with 
DLOBJ1,  if  the  proposed  moves  are  too  large,  DL0BJ2  may  be  reduced  and  if 
they  are  too  small,  DL0BJ2  may  be  increased. 

Both  DL0BJ1  and  DL0BJ2  are  updated  during  the  optimization  process  by 
keeping  track  of  progress.  Therefore,  their  initial  values  are  usually 
not  too  critical  except  for  highly  nonlinear  problems  where  no  progress 
can  be  made  due  to  very  large  estimates  for  ALPHA. 

DX1,  DX2  -  Used  in  all  one-dimensional  searches.  These  parameters  have  an 

equivilant  meaning  to  DL0BJ1  and  DL0BJ2,  but  here  are  applied  to  each 
component  of  the  X  vector.  The  same  general  rules  apply.  The  purpose  of 
DX1  and  DX2  is  to  prevent  very  large  initial  changes  in  the  components  of 
the  X  vector.  DX1  and  DX2  are  also  updated  during  the  optimization 
process . 
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P  M  LT 


L.'o  e in  ISTRAT  =  2,3  and  4 .  Initial  transition  point  from  interior  to 
e  r  i  •-  r  penalty  function.  EPSPEN  is  a  small  negative  number,  and  is 
a  ted  daring  optimization.  If  significant  constraint  violations  are 
ervcd  in  the  initial  stages,  this  should  be  made  more  negative.  The 
:c  concept  is  that ,  if  the  design  is  feasible,  a  penalty  is  imposed  for 
•:  _>r.s  triant  proportional  to  one  over  tiie  constriant  value  as  the 
■,;n.  approaches  the  feasible  boundary  (G  approaches  zero  from  the 
1 1  i  •••.••  side).  '-’hen  a  G  =  EPSPEN,  the  form  of  the  constriant  penalty 
ret  to  a  linear  (ISTRAT  =  2),  quadratic  ( ISTRAT  =  3)  or  cubic  (ISTRAT 
function  of  the  constraint. 

:  :  n  It- NED  =  4  and  3.  The  maximum  polynomial  extrapolation  .il  loved . 

:  ■:  r.e- 1!  imer.s  ional  search  routines  do  not  require  that  bound.;  first  be 
d  t.  the  minimum  of  the  function,  put  instead  extrapolate  for  c he 
.tit:t.  Because  extrapolation  is  relatively  unreliable,  EXTRA?  is  used 
1  i  m  i  tite  amount  of  extrapolation.  If  the  objective  and  constraints 
neatly  i  in  ear  ot  quadratic,  extrapolation  is  usual  iv  reliable,  and  ~v 
::  :n  c  reared.  If  the  objective  and/ or  const  r  rants  a.  re  highlv 

1  in oar .  this  is  ill-conditioned  and  EXTRA?  should  be  reduced.  I:  this 
:rs  .  ;  t  recommended  to  use  ZONED  =  3  or  7  instead. 


I've:  ::  MRAI  =  1  for  internal  gradient  calculations  by  ADS.  Gradients 
; :  a.  uived  by  first  forvard  finite  difference  unless  a  variable  is  at 

''tend.  In  this  case,  a  first  backvards  finite  difference  step 
taken  and  no  :heck  is  made  to  insure  that  the  resulting  design  variable 
.  above  its  lover  bound.  FDCH  is  the  finite  difference  step  sice  as  a 
: faction  of  the  design  variable  being  perturbed.  If  high  precision  is 
variable  and  required  in  evaluating  the  objective  and  constraint 
functions,  this  should  be  reduced.  If  the  analysis  is  iterative,  vith  its 
ovn  internal  convergence  parameters,  FDCh’  may  have  to  be  increase4.  For 


iterative  analysis,  a  value  of  FDCH  up  to  0.05  may  be  appropriate  for 
constrained  problems,  but  FDCH  =  0.02  is  a  more  reasonable  limit  for 
unconstrained  problems.  The  reason  for  this  is  that  ADS  seeks  the  point 
vhere  the  gradient  is  zero  for  unconstrained  problems,  and  if  FDCH  is 
large,  this  is  numerically  difficult  and  will  lead  to  false  gradient 
information.  On  the  other  hand,  for  constrained  problems,  the  gradients 
of  the  objective  and  critical  constraints  are  usually  non-zero  at  the 
optimum  and  so  precision  in  their  calculation  is  not  as  important. 

Used  if  IGRAD  =  0  for  internal  gradient  calculations  by  ADS.  This  is 
•n.e  minimum,  absolute  steplength  for  gradient  calculations.  This  is  used 
:  -  he  component  of  X  is  near  zero  since  a  fractional  change  may  not  be 

■ro.mir.gfui .  The  same  general  rules  apply  as  vith  FDCH. 

Used  with  ISTRAT  =  8.  Initial  penalty  parameter.  If  the  design  stays 
veil  inside  the  feasible  region,  this  can  be  reduced.  If  the  design  moves 
veil  outside  the  feasible  region,  this  should  be  increased. 

-  Penalty  multiplier  for  equality  constriants.  ADS  treats  equality 
constraints  by  adding  a  linear  multiplier  times  the  constriant  values  to 
the  objective  and  then  treating  the  constraint  as  an  inequality.  If  the 
equality  constriants  are  not  sufficiently  close  to  zero  at  the  optimum, 
increase  PMLT .  If  convergence  is  very  slow  because  the  optimization  is 
trying  to  follow  this  constriant  too  closely,  decrease  PHLT. 
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PSIAZ  -  Used  with  ISTRAT  =  8.  Used  to  avoid  constraint  violations.  This  has 
little  effect  because  of  algorithmic  modifications  made  to  ADS  and  the 
fact  that  the  ADS  optimizers  can  deal  well  with  constriant  violations. 

RMULT  -  Used  with  ISTRAT  -  1  and  ISTRAT  =  2-5  for  equality  constraints. 
Penalty  factor  multiplier  for  the  exterior  penalty  function  method.  If 
the  strategy  iterations  progress  slowly  from  far  outside  the  feasible 
region,  RMULT  should  be  increased.  If  the  design  seems  to  become  near 
feasible  quickly,  but  then  converge  poorly,  RMULT  should  be  decreased. 
RMULT  should  never  be  less  than  about  1.1. 

RMVLMZ  -  Used  with  strategies  6  through  9.  Initial  relative  move  limits.  If 
the  design  variables  alternately  go  from  +  to  -  the  move  limits,  this 

should  be  reduced.  If  the  design  variables  repeatedly  hit  one  side  (upper 
or  lower  limit),  this  should  be  increased.  Also  increase  RMVLMZ  is  the 
problem  is  known  to  be  nearly  linear  or  if  the  optimum  is  always  fully 
constrained  (has  as  many  active  constriants  as  there  are  design 

variables ) . 

RP  -  Used  with  ISTRAT  -  1  and  5  and  for  ISTRAT  =  2,  3  and  4  for  equality- 

constraints.  Initial  penalty  parameter  for  the  exterior  penalty  function 
method  and  the  Augmented  Lagrange  Multiplier  Method  and  for  equality- 

constraints  for  exterior  and  extended  interior  penalty  function  methods.. 

If  the  optimum  of  the  first  unconstrained  sub-problem  is  wll  outside  the 
feasible  region,  increase  RP.  If  the  optimum  of  the  first  unconstrained 
sup-problem  is  feasible  or  very  near  feasible  for  ISTRAT  =  1,  reduce  RP. 

RPMAX  -  Used  with  ISTRAT  =  1  and  5  and  for  ISTRAT  =  2,  3  and  4  for  equality 
constraints.  Maximum  value  of  RP  to  be  used.  If  optimum  is  significantly 
outside  the  feasible  region,  increase  RPMAX.  If  constraints  are  satisfied 
much  more  precisely  at  the  optimum  than  required,  reduce  RPMAX. 

RPMULT  -  Used  with  ISTRAT  =2,3  and  4.  Multiplier  on  RPPRIM  for  consecutive 
iterations.  Increase  if  convergence  is  very  slow  but  reliable.  Decrease 
if  convergence  is  far  from  (expected)  optimum. 

RPPMIN  -  Used  with  ISTRAT  =  2,  3  and  4.  Minimum  value  of  RPPRIM  to  be  used.  If 
optimum  is  well  inside  the  feasible  region,  reduce.  If  constraints  are 
more  precisely  satisfied  than  required,  increase. 

RPPRIM  -  Used  with  ISTRAT  =  2,  3  and  4.  Initial  penalty  parameter  for  extended 
penalty  function  methods.  If  the  result  of  the  first  unconstrained 
sub-problem  is  well  inside  the  feasible  region,  reduce.  If  the  result  is 
right  at  the  constraint  boundaries,  increase.  RPPRIM  is  reduced  on  each 
iteration  by  a  factor  RPMULT. 

STOL  -  Used  by  all  optimizers.  Tolorance  on  the  components  of  the  search 
direction  to  indicate  convergence  by  the  Kuhn  Tucker  conditions.  The 
Kuhn-Tucker  conditions  are  the  mathematical  conditions  that  are  satisfied 
at  a  precise  optimum.  These  cannot  generally  be  used  as  the  only 
convergence  criteria  since  this  is  numerically  difficult  to  achieve. 
However,  when  the  Kuhn-Tucker  conditions  are  met,  it  is  used  as  a 
convergence  criterion  which  supercedes  all  others.  Reducing  STOL  imposes 
a  more  stringent  convergence  criterion. 
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ZRO 


ICNDIR 


ISCAL 


UMAX 


-  Used  vith  luTT  =  and  5.  Normally  sh-i-tlcid  not  be  changed  if  I  OPT  -  5. 
rHETAZ  :s  the  nominal  "push -oft "  factor  for  the  method  of  feasible 
o  :  re-:  t  ic:v  .  If  •.!'.<•■  cons  t riant s  ate  highly  nonlinear,  increase  THETAZ.  If 

■  r.  u  t  r  a  i t  s  are  u'-nrlv  linear,  reduce  THETAZ  .  There  is  an  interaction 
:■  tvee.n  the  cons  t  r  i  an  t  t  oioranr IT  and  THETAZ.  If  constraints  are  highly 
nonlinear,  it  is  usually  preferable  to  increase  the  magnitude  of  CT  (make 

T  more  negative). 

-  Numerical  "zero"  to  indicate  reasonable  machine  accuracy.  Primarily 
used  internally  by  ADS  to  prevent  floating  point  divide  or  indicate  that 
the  numerical  zero  of  a  function  lias  been  found.  Normally  should  not  be 
changed . 


R  PARAMETERS  CONTAINED  IN  IWK 


-  Used  by  all  optimizers.  Conjugate  direction  or  variable  metric  restart 
parameter  to  restart  vi th  a  steepest  descent  direction  if  tie  objective  is 
currently  unconstrained  (no  constrains  are  active  or  violates).  The 
default  is  usually  adequate.  If  no  progress  is  being  "ado,  ADS  ’-ill 
automatically  over-ride  ICNDIR  and  restart  vi  th  a  cfeetvs’  descent 
direction. 

If  is  a  vorthvhile  exercise  to  solve  an  unconstrained  pr^ble-  vith  ICNDIR 

-  1.  This  vill  use  a  steepest  descent  direction  on  e’-’ery  iteration.  This 
is  the  classical  steepest  descent  method  and  a  comparison  of  this  vith  the 
ether  unconstrained  minimization  methods  in  ADS  vill  indicate  the  pover  of 
modern  methods. 

-  Turns  automatic  scaling  on/off.  If  the  problem  has  been  carefully 
scaled,  set  ISCAL  =  0.  Also,  in  general,  if  the  optimization  progress  is 
slov,  it  is  vorthvhile  to  try  ISCAL  =  0  to  see  if  the  automatic  scaling  in 
ADS  is  actually  causing  some  ill-conditioning.  The  present  scaling 
routine  in  ADS  is  much  improved  from  the  original  one  and  so  should  not 
cause  difficulty. 

-  Maximum  number  of  iterations  in  the  optimizer.  If  function  evaluations 
are  extremely  expensive,  reduce  ITMAX.  In  the  extreme  case  UMAX  =  1  or  2 
is  justified  because  the  first  few  iterations  are  where  most  progress  is 
made.  If  function  evaluations  are  not  expensive  and  the  optimization 
terminates  by  reaching  ITMAX,  it  should  be  increased.  When  using  a 
strategy,  ITMAX  should  be  at  least  10  to  insure  reasonable  solution  of  the 
rub-problem.  When  using  ISTRAT  =6,  7  or  9,  ITMAX  should  not  be  reduced 
because  the  optimizer  is  only  solving  a  simple  and  inexpensive  approximate 
c j b -problem .  In  these  cases,  the  optimizer  does  not  call  for  detailed 
function  evaluations. 


''red  by  all  optimizers.  The  number  of  consecutive  iterations  that  must 
-  • *  :  •:  fy  ’he  absolute  or  relative  convergence  criteria  before  optimization 
:  ••.•ruinated.  Usually  ITRMOP  should  be  at  least  2  because  it  is  common 
to  make  little  progress  on  one  iteration,  only  to  make  major  progress  on 
the  next.  Therefore,  ITRMOP  =  .  2  will  allov  a  second  try  before 
terminating. 
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ITRMST  -  Used  by  all  strategies.  The  number  of  consecutive  sub-optimizations 
that  must  satisfy  the  absolute  or  relative  strategy  convergence  criteria 
before  optimization  is  terminated.  The  same  rules  apply  as  to  ITRMOP, 
except  ITRMST  =  1  may  be  used.  This  is  because,  the  sub-problem  cannot 
make  progress,  and  therefore  solving  an  additional  sub-optimization 
problem  will  probably  not  help. 

JONED  -  Used  with  ISTRAT  =  8.  This  strategy  performs  an  additional 

one-dimensional  search.  Normally  the  one-dimensional  search  defined  by 
IONED  is  used.  If  a  different  one  is  desired,  it  is  defined  by  JONED. 
Sometimes  efficiency  or  reliability  can  be  improved  by  using  IONED  =  5  or 
6  and  JONED  =  7.  This  is  because  the  optimization  sub-problem  does  not 
call  for  detailed  function  evaluations  and  so  can  use  a  less  efficient, 
but  more  precise  one-dimensional  search. 

JTMAX  -  Maximum  number  of  strategy  iterations  to  be  allowed.  Reduce  if 

optimization  is  very  expensive.  Increase  if  optimization  is  stopped  by 
reaching  the  maximum  number  of  strategy  iterations  and  function 
evaluations  are  cheap. 
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